Aug 26 02:50:38 devstack cinder-volume[82943]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 02:50:38 devstack cinder-volume[82943]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:50:38 devstack cinder-volume[82943]: we strongly recommend against using it for new projects. Aug 26 02:50:38 devstack cinder-volume[82943]: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:50:38 devstack cinder-volume[82943]: framework. For more detail see Aug 26 02:50:38 devstack cinder-volume[82943]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:50:38 devstack cinder-volume[82943]: import eventlet # noqa Aug 26 02:50:42 devstack cinder-volume[82943]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:50:42 devstack cinder-volume[82943]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:50:42 devstack cinder-volume[82943]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:50:42 devstack cinder-volume[82943]: INFO dbcounter [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Registered counter for database cinder Aug 26 02:50:43 devstack cinder-volume[82943]: DEBUG oslo_db.sqlalchemy.engines [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:50:43 devstack cinder-volume[82943]: DEBUG dbcounter [-] [82943] Writer thread running {{(pid=82943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:50:43 devstack cinder-volume[82943]: INFO cinder.rpc [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 02:50:43 devstack cinder-volume[82943]: INFO cinder.rpc [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 02:50:43 devstack cinder-volume[82943]: DEBUG oslo_db.sqlalchemy.engines [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:50:43 devstack cinder-volume[82943]: INFO cinder.volume.manager [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Determined volume DB was empty at startup. Aug 26 02:50:43 devstack cinder-volume[82943]: DEBUG cinder.volume.manager [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82943) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 02:50:43 devstack cinder-volume[82943]: INFO cinder.volume.manager [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 02:50:43 devstack cinder-volume[82943]: WARNING stevedore.named [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:50:43 devstack cinder-volume[82943]: WARNING castellan.key_manager [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:50:43 devstack cinder-volume[82943]: WARNING cinder.keymgr.conf_key_mgr [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:50:43 devstack cinder-volume[82943]: DEBUG cinder.volume.drivers.lvm [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82943) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 26 02:50:43 devstack cinder-volume[82943]: DEBUG oslo_concurrency.processutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_concurrency.processutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] CMD "cinder-rtstool verify" returned: 0 in 0.522s {{(pid=82943) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_db.sqlalchemy.engines [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:50:44 devstack cinder-volume[82943]: INFO cinder.rpc [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 26 02:50:44 devstack cinder-volume[82943]: INFO cinder.rpc [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 26 02:50:44 devstack cinder-volume[82943]: WARNING stevedore.named [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:50:44 devstack cinder-volume[82943]: WARNING castellan.key_manager [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:50:44 devstack cinder-volume[82943]: INFO cinder.volume.manager [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_db.sqlalchemy.engines [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82943) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:50:44 devstack cinder-volume[82943]: INFO oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Starting 1 workers Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Started child 83140 {{(pid=82943) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Full set of CONF: {{(pid=82943) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] ******************************************************************************** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Configuration options gathered from: {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] ================================================================================ {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] allow_availability_zone_fallback = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] allow_compression_on_image_upload = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[83140]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] allowed_direct_url_schemes = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] api_rate_limit = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] auth_strategy = keystone {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] az_cache_duration = 3600 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_availability_zone = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_host = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_stats_polling_interval = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backup_api_class = cinder.backup.api.API {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backup_name_template = backup-%s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backup_use_same_host = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backup_use_temp_snapshot = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] chap_password = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] chap_username = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_internal_tenant_project_id = 687cc46abc244c0fb2870b7f4da0027b {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_internal_tenant_user_id = b2ad3fa1010b4892a6dd115b41ff5377 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cloned_volume_same_az = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cluster = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] compression_format = gzip {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] compute_api_class = cinder.compute.nova.API {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] config_dir = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] config_source = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] control_exchange = openstack {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] debug = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] default_availability_zone = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] default_group_type = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] default_volume_type = lvmdriver-1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] disk_geometry = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] driver_client_cert = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] driver_client_cert_key = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] driver_data_namespace = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] driver_ssl_cert_path = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] driver_ssl_cert_verify = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] driver_use_ssl = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] enable_force_upload = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] enable_new_services = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] enable_unsupported_driver = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] enabled_backends = ['lvmdriver-1'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] enforce_multipath_for_image_xfer = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] filter_function = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_api_insecure = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_api_ssl_compression = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_ca_certificates_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_catalog_info = image:glance:publicURL {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_num_retries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance_request_timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] goodness_function = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] graceful_shutdown_timeout = 5 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] group_api_class = cinder.group.api.API {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] host = devstack {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_compress_on_upload = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_conversion_address_space_limit = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_conversion_cpu_limit = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_conversion_disable = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_upload_use_cinder_backend = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_upload_use_internal_tenant = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_volume_cache_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_volume_cache_max_count = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] image_volume_cache_max_size_gb = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] init_host_max_objects_retrieval = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] instance_format = [instance: %(uuid)s] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] iscsi_target_flags = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] iscsi_write_cache = on {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] iser_helper = tgtadm {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] iser_ip_address = 192.168.122.229 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] iser_port = 3260 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_color = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_config_append = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_dir = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_options = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_rotate_interval = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_rotate_interval_type = days {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] log_rotation_type = none {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] max_age = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] max_logfile_count = 30 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] max_logfile_size_mb = 200 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] max_over_subscription_ratio = 20.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] message_reap_interval = 86400 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] message_ttl = 2592000 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] migration_create_volume_timeout_secs = 300 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] monkey_patch = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] monkey_patch_modules = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] my_ip = 192.168.122.229 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] no_snapshot_gb_quota = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] num_iser_scan_tries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] num_shell_tries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] num_volume_device_scan_tries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] nvmeof_conn_info_version = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] nvmet_ns_id = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] nvmet_port_id = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_max_limit = 1000 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_volume_ext_list = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_volume_listen = 0.0.0.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_volume_listen_port = 8776 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_volume_use_ssl = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] osapi_volume_workers = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] per_volume_size_limit = -1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] periodic_fuzzy_delay = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] periodic_interval = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] project_id_regex = [0-9a-f\-]+ {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] public_endpoint = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] publish_errors = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_backup_gigabytes = 1000 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_backups = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_gigabytes = 1000 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_groups = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_snapshots = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] quota_volumes = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] rate_limit_burst = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] rate_limit_except_level = CRITICAL {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] rate_limit_interval = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] reinit_driver_count = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] replication_device = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] report_discard_supported = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] report_interval = 120 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] reservation_clean_interval = 86400 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] reservation_expire = 86400 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] reserved_image_namespaces = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] reserved_percentage = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] rpc_response_timeout = 120 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] run_external_periodic_tasks = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] scst_target_driver = iscsi {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] scst_target_iqn_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_down_time = 720 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] shell_completion = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] snapshot_name_template = snapshot-%s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] snapshot_same_host = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] split_loggers = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] state_path = /opt/stack/data/cinder {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] storage_availability_zone = nova {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] storage_protocol = iSCSI {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] syslog_log_facility = LOG_USER {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] target_helper = lioadm {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] target_ip_address = 192.168.122.229 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] target_port = 3260 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] target_protocol = iscsi {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] target_secondary_ip_addresses = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] trace_flags = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] transfer_api_class = cinder.transfer.api.API {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] transport_url = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] until_refresh = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_chap_auth = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_default_quota_class = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_journal = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_json = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_multipath_for_image_xfer = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_stderr = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] use_syslog = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] verify_glance_signatures = enabled {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_api_class = cinder.volume.api.API {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_backend_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_clear = zero {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_clear_ionice = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_clear_size = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_copy_bps_limit = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_dd_blocksize = 1M {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_name_template = volume-%s {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_service_inithost_offload = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volume_usage_audit_period = month {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] zoning_mode = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_concurrency.disable_process_locking = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.auth_section = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.auth_type = password {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.auth_version = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.cache = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.delay_auth_decision = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.http_connect_timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.include_service_catalog = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.insecure = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.interface = public {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_password = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcache_username = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.region_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.service_token_roles_required = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.service_type = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.token_cache_time = 300 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.backend = dogpile.cache.null {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.backend_argument = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.backend_expiration_time = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.config_prefix = cache.oslo {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.debug_cache_backend = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.enable_retry_client = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.enable_socket_keepalive = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.expiration_time = 600 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.hashclient_retry_attempts = 2 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_dead_retry = 300 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_pool_maxsize = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_sasl_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.password = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.proxies = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.redis_db = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.redis_sentinel_service_name = mymaster {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.redis_server = localhost:6379 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.retry_attempts = 2 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.retry_delay = 0.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.socket_keepalive_count = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.socket_keepalive_idle = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.socket_keepalive_interval = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.socket_timeout = 1.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.tls_allowed_ciphers = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.tls_cafile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.tls_certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.tls_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.tls_keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cache.username = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] coordination.backend_url = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.asyncio_connection = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.asyncio_slave_connection = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.backend = sqlalchemy {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.connection = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.connection_debug = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.connection_parameters = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.connection_recycle_time = 3600 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.connection_trace = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.db_inc_retry_interval = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.db_max_retries = 20 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.db_max_retry_interval = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.db_retry_interval = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.max_overflow = 50 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.max_pool_size = 5 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.max_retries = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.mysql_wsrep_sync_wait = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.pool_timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.retry_interval = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.slave_connection = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.sqlite_synchronous = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.synchronous_reader = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] database.use_db_reconnect = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.connection_string = messaging:// {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.es_doc_type = notification {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.es_scroll_size = 10000 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.es_scroll_time = 2m {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.filter_error_trace = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.hmac_keys = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.sentinel_service_name = mymaster {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.socket_timeout = 0.1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.trace_requests = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler.trace_sqlalchemy = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler_jaeger.process_tags = {} {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler_jaeger.service_name_prefix = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] profiler_otlp.service_name_prefix = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.enforce_new_defaults = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.policy_default_rule = default {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.policy_file = policy.yaml {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_policy.remote_timeout = 60.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.group = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.helper_command = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] privsep_osbrick.user = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.group = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.helper_command = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] cinder_sys_admin.user = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.auth_section = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.auth_type = password {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.cafile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.collect_timing = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.insecure = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.send_service_user_token = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.split_loggers = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] service_user.timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.auth_section = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.auth_type = password {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.collect_timing = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.insecure = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.region_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.split_loggers = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] glance.timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.backend_availability_zone = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.chap_password = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.chap_username = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.disk_geometry = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.driver_client_cert = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.driver_client_cert_key = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.driver_data_namespace = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.driver_use_ssl = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.enable_unsupported_driver = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.extra_capabilities = {} {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.filter_function = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.goodness_function = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.iscsi_target_flags = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.iscsi_write_cache = on {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.iser_helper = tgtadm {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.iser_port = 3260 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.lvm_mirrors = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.lvm_share_target = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.lvm_type = auto {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.num_shell_tries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.nvmet_port_id = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.replication_device = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.report_discard_supported = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.reserved_percentage = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.scst_target_driver = iscsi {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.scst_target_iqn_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.storage_protocol = iSCSI {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.target_helper = tgtadm {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.target_port = 3260 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.target_protocol = iscsi {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.trace_flags = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.unique_fqdn_network = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.use_chap_auth = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_backend_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_clear = zero {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_clear_ionice = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_clear_size = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volume_group = cinder-volumes {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_reports.file_event_handler = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_reports.log_dir = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack sudo[83197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 26 02:50:44 devstack sudo[83197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.backend_availability_zone = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.backend_host = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.chap_password = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.chap_username = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.chiscsi_conf = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.disk_geometry = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.driver_client_cert = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.driver_data_namespace = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.driver_use_ssl = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.extra_capabilities = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.filter_function = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.goodness_function = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.iser_helper = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.iser_ip_address = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.iser_port = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.iser_target_prefix = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.lvm_conf_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.lvm_mirrors = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.lvm_share_target = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.lvm_type = auto {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.num_shell_tries = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.nvmet_port_id = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.replication_device = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.report_discard_supported = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.reserved_percentage = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.scst_target_driver = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.storage_protocol = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.target_helper = lioadm {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.target_ip_address = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.target_port = 3260 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.target_protocol = iscsi {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.trace_flags = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.use_chap_auth = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_clear = zero {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_clear_size = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] lvmdriver-1.volumes_dir = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.ssl_version = {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_notifications.driver = [] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_notifications.retry = -1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] key_manager.fixed_key = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.barbican_api_version = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.barbican_endpoint = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.barbican_endpoint_type = public {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.barbican_region_name = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.cafile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.collect_timing = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.insecure = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.number_of_retries = 60 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.retry_delay = 1 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.send_service_user_token = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.split_loggers = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.verify_ssl = True {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican.verify_ssl_path = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.auth_section = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.auth_type = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.cafile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.certfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.collect_timing = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.insecure = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.keyfile = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.split_loggers = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] barbican_service_user.timeout = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.approle_role_id = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.approle_secret_id = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.auth_method = approle {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.auth_path = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.kv_mountpoint = secret {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.kv_path = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.kv_version = 2 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.namespace = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.root_token_id = **** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.ssl_ca_crt_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.timeout = 60.0 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.token_file = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.token_role = None {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.use_ssl = False {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:50:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] ******************************************************************************** {{(pid=82943) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 02:50:44 devstack sudo[83197]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.326s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:44 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:44 devstack sudo[83294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:44 devstack sudo[83294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:45 devstack sudo[83294]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.285s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 02:50:45 devstack cinder-volume[83140]: INFO cinder.brick.local_dev.lvm [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:45 devstack sudo[83379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:45 devstack sudo[83379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:45 devstack sudo[83379]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG cinder.brick.local_dev.lvm [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83140) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 26 02:50:45 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:45 devstack sudo[83467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:45 devstack sudo[83467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:46 devstack sudo[83467]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:46 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:46 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:46 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.326s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:46 devstack sudo[83710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 26 02:50:46 devstack sudo[83710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:47 devstack sudo[83710]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.418s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:47 devstack sudo[83789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:47 devstack sudo[83789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:47 devstack sudo[83789]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:47 devstack sudo[83798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:47 devstack sudo[83798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:47 devstack sudo[83798]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:47 devstack sudo[83881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:47 devstack sudo[83881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:47 devstack sudo[83881]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:47 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:48 devstack sudo[83884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:48 devstack sudo[83884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:48 devstack sudo[83884]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.365s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:48 devstack sudo[83888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:48 devstack sudo[83888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:48 devstack sudo[83888]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.314s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:48 devstack cinder-volume[83140]: INFO cinder.volume.drivers.lvm [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:48 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:48 devstack sudo[83892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:48 devstack sudo[83892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:49 devstack sudo[83892]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:49 devstack sudo[83895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:49 devstack sudo[83895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:49 devstack sudo[83895]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:49 devstack sudo[83904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:49 devstack sudo[83904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:49 devstack sudo[83904]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:49 devstack sudo[83909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:49 devstack sudo[83909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:49 devstack sudo[83909]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:49 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:49 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:49 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:50 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.342s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:50 devstack cinder-volume[83140]: INFO cinder.volume.driver [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG cinder.volume.driver [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83140) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG oslo_db.sqlalchemy.engines [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83140) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writer thread running {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG cinder.db.api [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Building query based on filter {{(pid=83140) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG cinder.image.image_utils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83140) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 02:50:50 devstack cinder-volume[83140]: INFO cinder.keymgr.migration [None req-1eca6f59-3639-45ae-a991-5bc01354dcf3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:50 devstack sudo[83917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:50 devstack sudo[83917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:50 devstack sudo[83917]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:50 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:50 devstack sudo[83921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:50 devstack sudo[83921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:51 devstack sudo[83921]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.350s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:51 devstack sudo[83925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:51 devstack sudo[83925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:51 devstack sudo[83925]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:51 devstack sudo[83929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:51 devstack sudo[83929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:51 devstack sudo[83929]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:50:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Driver initialization completed successfully. Aug 26 02:50:51 devstack cinder-volume[83140]: INFO cinder.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Initiating service 2 cleanup Aug 26 02:50:51 devstack cinder-volume[83140]: INFO cinder.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Service 2 cleanup completed. Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG cinder.service [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Creating RPC server for service cinder-volume {{(pid=83140) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG cinder.service [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83140) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 02:50:51 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:50:51 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:52 devstack sudo[83933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:50:52 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:52 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:52 devstack sudo[83936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:52 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:52 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:52 devstack sudo[83943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:50:52 devstack sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:52 devstack sudo[83943]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:52 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:50:52 devstack sudo[83951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:50:52 devstack sudo[83951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:50:53 devstack sudo[83951]: pam_unix(sudo:session): session closed for user root Aug 26 02:50:53 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:50:53 devstack cinder-volume[83140]: INFO cinder.volume.manager [None req-6f905876-20d9-4eb5-a67c-33ea8ab102a6 None None] Driver post RPC initialization completed successfully. Aug 26 02:50:54 devstack cinder-volume[82943]: DEBUG dbcounter [-] [82943] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82943) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:51:00 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=2 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:51:03 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:51:20 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager._thread_info {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:51:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread count: 6 {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:51:20 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread info: [<_MainThread(MainThread, started 137884962193536)>, , , , , ] {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:20 devstack sudo[86612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:52:20 devstack sudo[86612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:20 devstack sudo[86612]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:20 devstack sudo[86615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:52:20 devstack sudo[86615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:20 devstack sudo[86615]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:21 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:52:21 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:21 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:52:21 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:52:21 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:52:21 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager._thread_info {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread count: 6 {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:52:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread info: [<_MainThread(MainThread, started 137884962193536)>, , , , , ] {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:53:03 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=1 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:53:03 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=1 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:20 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:53:20 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:20 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:20 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:53:20 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:20 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:20 devstack sudo[89597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:53:20 devstack sudo[89597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:21 devstack sudo[89597]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:53:21 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:53:21 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:53:21 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Aug 26 02:53:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:53:21 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:54:20 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:54:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:54:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:54:20 devstack sudo[91530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:54:20 devstack sudo[91530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:54:20 devstack sudo[91530]: pam_unix(sudo:session): session closed for user root Aug 26 02:54:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:54:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:54:20 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:54:20 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:54:20 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:54:21 devstack sudo[91556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:54:21 devstack sudo[91556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:54:21 devstack sudo[91556]: pam_unix(sudo:session): session closed for user root Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:54:21 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:54:21 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:54:21 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.303s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager._thread_info {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread count: 6 {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:54:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread info: [<_MainThread(MainThread, started 137884962193536)>, , , , , ] {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:55:03 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:SELECT=1 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:03 devstack cinder-volume[83140]: DEBUG dbcounter [-] [83140] Writing DB stats cinder:UPDATE=1 {{(pid=83140) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:55:20 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:55:20 devstack cinder-volume[83140]: DEBUG cinder.volume.drivers.lvm [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Updating volume stats {{(pid=83140) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 26 02:55:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:20 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 26 02:55:20 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:20 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:20 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:20 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:55:20 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:20 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:21 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 26 02:55:21 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:21 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:21 devstack sudo[93114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 26 02:55:21 devstack sudo[93114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:21 devstack sudo[93114]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG oslo_concurrency.processutils [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=83140) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG cinder.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Notifying Schedulers of capabilities ... {{(pid=83140) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG oslo_service.periodic_task [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] Running periodic task VolumeManager._thread_info {{(pid=83140) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread count: 6 {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:55:21 devstack cinder-volume[83140]: DEBUG cinder.volume.manager [None req-3f986e2d-d617-4546-81e6-3762c4ad0458 None None] thread info: [<_MainThread(MainThread, started 137884962193536)>, , , , , ] {{(pid=83140) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:55:44 devstack cinder-volume[82943]: INFO oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Caught SIGTERM, stopping children Aug 26 02:55:44 devstack cinder-volume[82943]: DEBUG oslo_concurrency.lockutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Acquiring lock "singleton_lock" {{(pid=82943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:55:44 devstack cinder-volume[82943]: DEBUG oslo_concurrency.lockutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Acquired lock "singleton_lock" {{(pid=82943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:55:44 devstack cinder-volume[82943]: DEBUG oslo_concurrency.lockutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Releasing lock "singleton_lock" {{(pid=82943) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:55:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Stop services. {{(pid=82943) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 02:55:44 devstack cinder-volume[82943]: DEBUG oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Killing children. {{(pid=82943) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 02:55:44 devstack cinder-volume[82943]: INFO oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Waiting on 1 children to exit Aug 26 02:55:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Acquiring lock "singleton_lock" {{(pid=83140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:55:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Acquired lock "singleton_lock" {{(pid=83140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:55:46 devstack cinder-volume[83140]: DEBUG oslo_concurrency.lockutils [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Releasing lock "singleton_lock" {{(pid=83140) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:55:46 devstack cinder-volume[83140]: WARNING amqp [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:55:46 devstack cinder-volume[83140]: WARNING amqp [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:55:46 devstack cinder-volume[82943]: INFO oslo_service.backend._eventlet.service [None req-406bf27c-fb5a-4b15-8233-1a1b593eee7a None None] Child 83140 exited with status 0 Aug 26 02:55:47 devstack cinder-volume[93661]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 02:55:47 devstack cinder-volume[93661]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:55:47 devstack cinder-volume[93661]: we strongly recommend against using it for new projects. Aug 26 02:55:47 devstack cinder-volume[93661]: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:55:47 devstack cinder-volume[93661]: framework. For more detail see Aug 26 02:55:47 devstack cinder-volume[93661]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:55:47 devstack cinder-volume[93661]: import eventlet # noqa Aug 26 02:55:49 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:55:49 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:55:49 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:55:50 devstack cinder-volume[93661]: INFO dbcounter [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Registered counter for database cinder Aug 26 02:55:50 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:55:50 devstack cinder-volume[93661]: DEBUG dbcounter [-] [93661] Writer thread running {{(pid=93661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:55:50 devstack cinder-volume[93661]: INFO cinder.rpc [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 02:55:50 devstack cinder-volume[93661]: INFO cinder.rpc [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 02:55:50 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:55:51 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Determined volume DB was empty at startup. Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG cinder.volume.manager [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93661) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 02:55:51 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 26 02:55:51 devstack cinder-volume[93661]: WARNING stevedore.named [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:55:51 devstack cinder-volume[93661]: WARNING castellan.key_manager [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:55:51 devstack cinder-volume[93661]: WARNING cinder.keymgr.conf_key_mgr [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:55:51 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:55:51 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Starting 1 workers Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Started child 93876 {{(pid=93661) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Full set of CONF: {{(pid=93661) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] ******************************************************************************** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Configuration options gathered from: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] ================================================================================ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] allow_availability_zone_fallback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] allow_compression_on_image_upload = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] allowed_direct_url_schemes = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] api_rate_limit = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] auth_strategy = keystone {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_host = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93876]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_stats_polling_interval = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backup_api_class = cinder.backup.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backup_name_template = backup-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backup_use_same_host = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backup_use_temp_snapshot = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] chap_username = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_internal_tenant_project_id = 687cc46abc244c0fb2870b7f4da0027b {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_internal_tenant_user_id = b2ad3fa1010b4892a6dd115b41ff5377 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cluster = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] compression_format = gzip {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] compute_api_class = cinder.compute.nova.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] config_dir = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] config_source = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] control_exchange = openstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] debug = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] default_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] default_group_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] default_volume_type = QuobyteHD {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] driver_ssl_cert_verify = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] driver_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] enable_new_services = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] enable_unsupported_driver = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] enabled_backends = ['QuobyteHD'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] enforce_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_api_insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_api_ssl_compression = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_ca_certificates_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_catalog_info = image:glance:publicURL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_num_retries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance_request_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] graceful_shutdown_timeout = 5 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] group_api_class = cinder.group.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] host = devstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_compress_on_upload = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_conversion_address_space_limit = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_conversion_cpu_limit = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_conversion_disable = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_upload_use_cinder_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_upload_use_internal_tenant = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_volume_cache_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_volume_cache_max_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] image_volume_cache_max_size_gb = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] init_host_max_objects_retrieval = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] instance_format = [instance: %(uuid)s] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] iscsi_target_flags = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] iscsi_write_cache = on {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] iser_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] iser_ip_address = 192.168.122.229 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] iser_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_color = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_config_append = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_dir = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_options = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_rotate_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_rotate_interval_type = days {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] log_rotation_type = none {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] max_age = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] max_logfile_count = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] max_logfile_size_mb = 200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] max_over_subscription_ratio = 20.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] message_reap_interval = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] message_ttl = 2592000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] migration_create_volume_timeout_secs = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] monkey_patch = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] monkey_patch_modules = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] my_ip = 192.168.122.229 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] no_snapshot_gb_quota = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] num_iser_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] num_shell_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] num_volume_device_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] nvmeof_conn_info_version = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] nvmet_ns_id = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] nvmet_port_id = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_max_limit = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_volume_ext_list = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_volume_listen_port = 8776 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_volume_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] osapi_volume_workers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] per_volume_size_limit = -1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] periodic_fuzzy_delay = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] periodic_interval = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] public_endpoint = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] publish_errors = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_backup_gigabytes = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_backups = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_gigabytes = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_groups = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_snapshots = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] quota_volumes = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] rate_limit_burst = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] rate_limit_except_level = CRITICAL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] rate_limit_interval = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] reinit_driver_count = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] report_discard_supported = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] report_interval = 120 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] reservation_clean_interval = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] reservation_expire = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] reserved_image_namespaces = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] reserved_percentage = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] rpc_response_timeout = 120 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] run_external_periodic_tasks = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] scst_target_driver = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_down_time = 720 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] shell_completion = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] snapshot_name_template = snapshot-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] state_path = /opt/stack/data/cinder {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] storage_availability_zone = nova {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] storage_protocol = iSCSI {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] syslog_log_facility = LOG_USER {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] target_helper = lioadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] target_ip_address = 192.168.122.229 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] target_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] target_protocol = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] target_secondary_ip_addresses = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] trace_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] transport_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] until_refresh = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_chap_auth = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_default_quota_class = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_journal = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_json = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_stderr = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] use_syslog = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] verify_glance_signatures = enabled {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_api_class = cinder.volume.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_clear = zero {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_clear_size = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_copy_bps_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_dd_blocksize = 1M {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_name_template = volume-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_service_inithost_offload = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volume_usage_audit_period = month {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] zoning_mode = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_concurrency.disable_process_locking = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.auth_type = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.auth_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.include_service_catalog = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.interface = public {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcache_username = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.service_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.backend = dogpile.cache.null {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.backend_argument = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.backend_expiration_time = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.config_prefix = cache.oslo {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.debug_cache_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.enable_retry_client = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.enable_socket_keepalive = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.expiration_time = 600 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.hashclient_retry_attempts = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_dead_retry = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_sasl_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.proxies = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.redis_db = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.redis_server = localhost:6379 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.retry_attempts = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.retry_delay = 0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.socket_keepalive_count = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.socket_keepalive_idle = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.socket_keepalive_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.socket_timeout = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.tls_allowed_ciphers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.tls_cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.tls_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.remotefs [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93876) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.tls_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.tls_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cache.username = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] coordination.backend_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.asyncio_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.asyncio_slave_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.backend = sqlalchemy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.connection_debug = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.connection_parameters = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.connection_recycle_time = 3600 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.connection_trace = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.db_inc_retry_interval = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.db_max_retries = 20 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.db_max_retry_interval = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.db_retry_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.max_overflow = 50 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.max_pool_size = 5 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.max_retries = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.mysql_wsrep_sync_wait = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.pool_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.retry_interval = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.slave_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.sqlite_synchronous = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.synchronous_reader = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] database.use_db_reconnect = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.connection_string = messaging:// {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.es_doc_type = notification {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.es_scroll_size = 10000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.es_scroll_time = 2m {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.filter_error_trace = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.hmac_keys = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.sentinel_service_name = mymaster {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.socket_timeout = 0.1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.trace_requests = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler.trace_sqlalchemy = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler_jaeger.process_tags = {} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler_jaeger.service_name_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] profiler_otlp.service_name_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.enforce_new_defaults = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.policy_default_rule = default {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.policy_file = policy.yaml {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.group = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.helper_command = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] privsep_osbrick.user = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.group = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.helper_command = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] cinder_sys_admin.user = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.auth_type = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.send_service_user_token = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] service_user.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.auth_type = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] glance.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.chap_username = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.driver_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.extra_capabilities = {} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.iscsi_target_flags = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.iscsi_write_cache = on {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.iser_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.iser_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_host = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_login = admin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_mount_options = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_private_key = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_share_path = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.num_shell_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.quobyte_volume_url = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.report_discard_supported = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.reserved_percentage = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.target_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.target_port = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.target_protocol = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.trace_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.unique_fqdn_network = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.use_chap_auth = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_clear = zero {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_clear_size = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_reports.file_event_handler = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_reports.log_dir = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.backend_host = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.chap_username = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.chiscsi_conf = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.driver_use_ssl = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.extra_capabilities = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.iser_helper = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.iser_ip_address = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.iser_port = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.iser_target_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_host = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_login = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_mount_options = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_private_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_share_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_ssh_port = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.num_shell_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.nvmet_port_id = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.report_discard_supported = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.reserved_percentage = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.scst_target_driver = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.storage_protocol = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.target_helper = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.target_ip_address = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.target_port = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.target_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.target_protocol = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.trace_flags = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.use_chap_auth = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_clear = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_clear_size = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] QuobyteHD.volumes_dir = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_notifications.driver = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_notifications.retry = -1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] key_manager.fixed_key = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.barbican_api_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.barbican_endpoint = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.barbican_endpoint_type = public {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.barbican_region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.number_of_retries = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.retry_delay = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.send_service_user_token = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.verify_ssl = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican.verify_ssl_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.auth_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] barbican_service_user.timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.approle_role_id = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.approle_secret_id = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.auth_method = approle {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.auth_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.kv_mountpoint = secret {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.kv_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.kv_version = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.root_token_id = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.ssl_ca_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.timeout = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.token_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.token_role = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:55:51 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] ******************************************************************************** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93876) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 02:55:51 devstack cinder-volume[93876]: WARNING cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 02:55:51 devstack cinder-volume[93876]: WARNING cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Running cmd (subprocess): mount.quobyte {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:51 devstack quobyte-client[93881]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 02:55:51 devstack quobyte-client[93881]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] CMD "mount.quobyte" returned: 1 in 0.087s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:51 devstack cinder-volume[93876]: INFO cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de ... Aug 26 02:55:51 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed -c /etc/quobyte/client-cinder.cfg {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:51 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed -c /etc/quobyte/client-cinder.cfg Aug 26 02:55:51 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:52 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.424s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de succeeded Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.437s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:52 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:55:52 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:52 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.285s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.volume.driver [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.volume.driver [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8181190490723, 'free_capacity_gb': 1774.8181190490723, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93876) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_db.sqlalchemy.engines [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93876) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG dbcounter [-] [93876] Writer thread running {{(pid=93876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.db.api [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Building query based on filter {{(pid=93876) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.image.image_utils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93876) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.keymgr.migration [None req-a537ff4d-e92f-4e66-9d60-43c58dfd5e6c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:52 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:55:52 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:52 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.289s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Notifying Schedulers of capabilities ... {{(pid=93876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Driver initialization completed successfully. Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Initiating service 3 cleanup Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Service 3 cleanup completed. Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.service [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Creating RPC server for service cinder-volume {{(pid=93876) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.service [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93876) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 02:55:52 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:52 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:53 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:55:53 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:53 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:53 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.282s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:53 devstack cinder-volume[93876]: INFO cinder.volume.manager [None req-b2b7b0d7-776b-4b7c-873c-f1b66e532d71 None None] Driver post RPC initialization completed successfully. Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=93876) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG cinder.volume.drivers.quobyte [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=93876) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93876) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:55:58 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:55:58 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:55:58 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG oslo_concurrency.processutils [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.249s {{(pid=93876) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:55:58 devstack cinder-volume[93876]: DEBUG cinder.manager [None req-ecda43c4-6b16-42dc-9232-f69e408a92c6 None None] Notifying Schedulers of capabilities ... {{(pid=93876) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:56:00 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Caught SIGTERM, stopping children Aug 26 02:56:00 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Acquiring lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:56:00 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Acquired lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:56:00 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Releasing lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:56:00 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Stop services. {{(pid=93661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 26 02:56:00 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Killing children. {{(pid=93661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 26 02:56:00 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Waiting on 1 children to exit Aug 26 02:56:02 devstack cinder-volume[93876]: DEBUG dbcounter [-] [93876] Writing DB stats cinder:SELECT=3 {{(pid=93876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:03 devstack cinder-volume[93876]: DEBUG dbcounter [-] [93876] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=93876) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:06 devstack cinder-volume[93876]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 26 02:56:06 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Acquiring lock "singleton_lock" {{(pid=93876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:56:06 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Acquired lock "singleton_lock" {{(pid=93876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:56:06 devstack cinder-volume[93876]: DEBUG oslo_concurrency.lockutils [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Releasing lock "singleton_lock" {{(pid=93876) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:56:06 devstack cinder-volume[93876]: WARNING amqp [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:56:06 devstack cinder-volume[93876]: WARNING amqp [None req-407f2b2c-a1e3-477c-9719-7af2eaf77287 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 26 02:56:06 devstack cinder-volume[94205]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 26 02:56:06 devstack cinder-volume[94205]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:56:06 devstack cinder-volume[94205]: we strongly recommend against using it for new projects. Aug 26 02:56:06 devstack cinder-volume[94205]: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:56:06 devstack cinder-volume[94205]: framework. For more detail see Aug 26 02:56:06 devstack cinder-volume[94205]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:56:06 devstack cinder-volume[94205]: import eventlet # noqa Aug 26 02:56:09 devstack cinder-volume[94205]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 26 02:56:09 devstack cinder-volume[94205]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 26 02:56:09 devstack cinder-volume[94205]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94205) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 26 02:56:10 devstack cinder-volume[94205]: INFO dbcounter [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Registered counter for database cinder Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_db.sqlalchemy.engines [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG dbcounter [-] [94205] Writer thread running {{(pid=94205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:56:10 devstack cinder-volume[94205]: INFO cinder.rpc [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 26 02:56:10 devstack cinder-volume[94205]: INFO cinder.rpc [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_db.sqlalchemy.engines [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:56:10 devstack cinder-volume[94205]: INFO cinder.volume.manager [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Determined volume DB was empty at startup. Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG cinder.volume.manager [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94205) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 26 02:56:10 devstack cinder-volume[94205]: WARNING stevedore.named [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 26 02:56:10 devstack cinder-volume[94205]: WARNING castellan.key_manager [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:56:10 devstack cinder-volume[94205]: WARNING cinder.keymgr.conf_key_mgr [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 26 02:56:10 devstack cinder-volume[94205]: INFO cinder.volume.manager [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_db.sqlalchemy.engines [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94205) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:56:10 devstack cinder-volume[94205]: INFO oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Starting 1 workers Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Started child 94506 {{(pid=94205) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Full set of CONF: {{(pid=94205) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] ******************************************************************************** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] Configuration options gathered from: {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Aug 26 02:56:10 devstack cinder-volume[94506]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] ================================================================================ {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] allow_availability_zone_fallback = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] allow_compression_on_image_upload = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] allowed_direct_url_schemes = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] api_rate_limit = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] auth_strategy = keystone {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_availability_zone = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_host = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_stats_polling_interval = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backup_api_class = cinder.backup.api.API {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backup_name_template = backup-%s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backup_use_same_host = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backup_use_temp_snapshot = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] chap_password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] chap_username = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_internal_tenant_project_id = 687cc46abc244c0fb2870b7f4da0027b {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_internal_tenant_user_id = b2ad3fa1010b4892a6dd115b41ff5377 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cluster = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] compression_format = gzip {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] compute_api_class = cinder.compute.nova.API {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] config_dir = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] config_source = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] control_exchange = openstack {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] debug = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] default_availability_zone = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] default_group_type = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] default_volume_type = QuobyteHD {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] disk_geometry = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] driver_client_cert = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] driver_client_cert_key = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] driver_data_namespace = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] driver_ssl_cert_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] driver_ssl_cert_verify = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] driver_use_ssl = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] enable_new_services = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] enable_unsupported_driver = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] enabled_backends = ['QuobyteHD'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] enforce_multipath_for_image_xfer = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] filter_function = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_api_insecure = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_api_servers = ['http://192.168.122.229/image'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_api_ssl_compression = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_ca_certificates_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_catalog_info = image:glance:publicURL {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_num_retries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance_request_timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Starting volume driver QuobyteDriver (1.2.1) Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] goodness_function = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] graceful_shutdown_timeout = 5 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94506) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] group_api_class = cinder.group.api.API {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] host = devstack {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_compress_on_upload = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_conversion_address_space_limit = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_conversion_cpu_limit = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_conversion_disable = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_upload_use_cinder_backend = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_upload_use_internal_tenant = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_volume_cache_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_volume_cache_max_count = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] image_volume_cache_max_size_gb = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] init_host_max_objects_retrieval = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] instance_format = [instance: %(uuid)s] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] iscsi_target_flags = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] iscsi_write_cache = on {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] iser_helper = tgtadm {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] iser_ip_address = 192.168.122.229 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] iser_port = 3260 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_color = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_config_append = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_dir = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_options = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_rotate_interval = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_rotate_interval_type = days {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] log_rotation_type = none {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] max_age = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] max_logfile_count = 30 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] max_logfile_size_mb = 200 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] max_over_subscription_ratio = 20.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] message_reap_interval = 86400 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] message_ttl = 2592000 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] migration_create_volume_timeout_secs = 300 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] monkey_patch = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] monkey_patch_modules = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] my_ip = 192.168.122.229 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] no_snapshot_gb_quota = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] num_iser_scan_tries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] num_shell_tries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] num_volume_device_scan_tries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] nvmeof_conn_info_version = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] nvmet_ns_id = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] nvmet_port_id = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_max_limit = 1000 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_volume_ext_list = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_volume_listen = 0.0.0.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_volume_listen_port = 8776 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_volume_use_ssl = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] osapi_volume_workers = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] per_volume_size_limit = -1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] periodic_fuzzy_delay = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] periodic_interval = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] project_id_regex = [0-9a-f\-]+ {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] public_endpoint = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] publish_errors = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_backup_gigabytes = 1000 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_backups = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_gigabytes = 1000 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_groups = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_snapshots = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] quota_volumes = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] rate_limit_burst = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] rate_limit_except_level = CRITICAL {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] rate_limit_interval = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] reinit_driver_count = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] replication_device = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] report_discard_supported = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] report_interval = 120 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] reservation_clean_interval = 86400 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] reservation_expire = 86400 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] reserved_image_namespaces = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] reserved_percentage = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] rpc_response_timeout = 120 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] run_external_periodic_tasks = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] scst_target_driver = iscsi {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] scst_target_iqn_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_down_time = 720 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] shell_completion = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] snapshot_name_template = snapshot-%s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] split_loggers = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] state_path = /opt/stack/data/cinder {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] storage_availability_zone = nova {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] storage_protocol = iSCSI {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] syslog_log_facility = LOG_USER {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] target_helper = lioadm {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] target_ip_address = 192.168.122.229 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] target_port = 3260 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] target_protocol = iscsi {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] target_secondary_ip_addresses = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] trace_flags = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] transfer_api_class = cinder.transfer.api.API {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] transport_url = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] until_refresh = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_chap_auth = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_default_quota_class = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_journal = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_json = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_multipath_for_image_xfer = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_stderr = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] use_syslog = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] verify_glance_signatures = enabled {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_api_class = cinder.volume.api.API {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_backend_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_clear = zero {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_clear_ionice = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_clear_size = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94506) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_copy_bps_limit = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_dd_blocksize = 1M {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_name_template = volume-%s {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_service_inithost_offload = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volume_usage_audit_period = month {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Running cmd (subprocess): mount.quobyte {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] zoning_mode = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_concurrency.disable_process_locking = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.auth_section = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.auth_type = password {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.auth_version = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.cache = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.include_service_catalog = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.insecure = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.interface = public {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcache_username = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.region_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.service_type = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.229/identity {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.backend = dogpile.cache.null {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.backend_argument = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.backend_expiration_time = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.config_prefix = cache.oslo {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.debug_cache_backend = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.enable_retry_client = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.enable_socket_keepalive = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.expiration_time = 600 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.hashclient_retry_attempts = 2 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_dead_retry = 300 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_pool_maxsize = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_sasl_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.proxies = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.redis_db = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.redis_server = localhost:6379 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.retry_attempts = 2 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.retry_delay = 0.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.socket_keepalive_count = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.socket_keepalive_idle = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.socket_keepalive_interval = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.socket_timeout = 1.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.tls_allowed_ciphers = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.tls_cafile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.tls_certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.tls_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.tls_keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cache.username = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] coordination.backend_url = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.asyncio_connection = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.asyncio_slave_connection = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.backend = sqlalchemy {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.connection = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.connection_debug = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.connection_parameters = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.connection_recycle_time = 3600 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.connection_trace = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.db_inc_retry_interval = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.db_max_retries = 20 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.db_max_retry_interval = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.db_retry_interval = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.max_overflow = 50 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.max_pool_size = 5 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.max_retries = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.mysql_wsrep_sync_wait = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.pool_timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.retry_interval = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.slave_connection = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:10 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.sqlite_synchronous = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.synchronous_reader = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] database.use_db_reconnect = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.connection_string = messaging:// {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.es_doc_type = notification {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.es_scroll_size = 10000 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.es_scroll_time = 2m {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.filter_error_trace = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack quobyte-client[94509]: Reading configuration file: /etc/quobyte/client.cfg Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.hmac_keys = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.sentinel_service_name = mymaster {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.socket_timeout = 0.1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.trace_requests = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler.trace_sqlalchemy = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler_jaeger.process_tags = {} {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler_jaeger.service_name_prefix = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack quobyte-client[94509]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] profiler_otlp.service_name_prefix = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.enforce_new_defaults = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.policy_default_rule = default {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.policy_file = policy.yaml {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_policy.remote_timeout = 60.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.group = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.helper_command = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] privsep_osbrick.user = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.group = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.helper_command = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] cinder_sys_admin.user = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.auth_section = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.auth_type = password {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.cafile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.collect_timing = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] CMD "mount.quobyte" returned: 1 in 0.063s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.insecure = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.send_service_user_token = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.split_loggers = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] service_user.timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.auth_section = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.auth_type = password {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.collect_timing = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.insecure = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.region_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.split_loggers = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] glance.timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.backend_availability_zone = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.chap_password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.chap_username = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.disk_geometry = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.driver_client_cert = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.driver_client_cert_key = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.driver_data_namespace = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.driver_use_ssl = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.extra_capabilities = {} {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.filter_function = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.goodness_function = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.iscsi_target_flags = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.iscsi_write_cache = on {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.iser_helper = tgtadm {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.iser_ip_address = 192.168.122.229 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.iser_port = 3260 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_host = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_login = admin {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_mount_options = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_private_key = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_share_path = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_ssh_port = 22 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.num_shell_tries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.quobyte_volume_url = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.replication_device = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.report_discard_supported = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.reserved_percentage = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.target_helper = tgtadm {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.target_ip_address = 192.168.122.229 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.target_port = 3260 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.target_protocol = iscsi {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.trace_flags = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.unique_fqdn_network = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.use_chap_auth = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_backend_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_clear = zero {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_clear_ionice = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_clear_size = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_reports.file_event_handler = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_reports.log_dir = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.backend_availability_zone = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.backend_host = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.chap_password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.chap_username = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.chiscsi_conf = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.disk_geometry = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.driver_client_cert = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.driver_data_namespace = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.driver_use_ssl = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.extra_capabilities = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.filter_function = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.goodness_function = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.iscsi_target_flags = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.iscsi_write_cache = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.iser_helper = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.iser_ip_address = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.iser_port = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.iser_target_prefix = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_host = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_login = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_mount_options = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_password = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_private_key = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_share_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_ssh_port = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.num_shell_tries = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nvmet_ns_id = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.nvmet_port_id = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.replication_device = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.report_discard_supported = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.reserved_percentage = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.scst_target_driver = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.storage_protocol = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.target_helper = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.target_ip_address = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.target_port = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.target_prefix = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.target_protocol = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.trace_flags = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.unique_fqdn_network = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.use_chap_auth = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_clear = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_clear_ionice = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_clear_size = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] QuobyteHD.volumes_dir = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.ssl_version = {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_notifications.driver = [] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_notifications.retry = -1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] key_manager.fixed_key = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.barbican_api_version = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.barbican_endpoint = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.barbican_endpoint_type = public {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.barbican_region_name = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.cafile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.collect_timing = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.insecure = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.number_of_retries = 60 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.retry_delay = 1 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.send_service_user_token = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.split_loggers = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.verify_ssl = True {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican.verify_ssl_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.auth_section = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.auth_type = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.cafile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.certfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.collect_timing = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.insecure = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.keyfile = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.split_loggers = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] barbican_service_user.timeout = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.approle_role_id = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.approle_secret_id = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.auth_method = approle {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.auth_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.kv_mountpoint = secret {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.kv_path = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.kv_version = 2 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.namespace = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.root_token_id = **** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.ssl_ca_crt_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.timeout = 60.0 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.token_file = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.token_role = None {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.use_ssl = False {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Aug 26 02:56:11 devstack cinder-volume[94205]: DEBUG oslo_service.backend._eventlet.service [None req-34149f35-e102-4082-8c91-35aa683c2507 None None] ******************************************************************************** {{(pid=94205) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Aug 26 02:56:11 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:11 devstack cinder-volume[94506]: INFO cinder.volume.driver [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Driver hasn't implemented _init_vendor_properties() Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.driver [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8174476623535, 'free_capacity_gb': 1774.8174476623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94506) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_db.sqlalchemy.engines [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writer thread running {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.db.api [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Building query based on filter {{(pid=94506) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94506) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:11 devstack cinder-volume[94506]: INFO cinder.keymgr.migration [None req-04a63e12-3eaf-4065-8fc0-bb2b1c463743 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 26 02:56:11 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:56:11 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:11 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.238s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:56:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Driver initialization completed successfully. Aug 26 02:56:11 devstack cinder-volume[94506]: INFO cinder.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Initiating service 3 cleanup Aug 26 02:56:11 devstack cinder-volume[94506]: INFO cinder.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Service 3 cleanup completed. Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.service [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Creating RPC server for service cinder-volume {{(pid=94506) start /opt/stack/cinder/cinder/service.py:231}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.service [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94506) start /opt/stack/cinder/cinder/service.py:237}} Aug 26 02:56:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:56:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:56:11 devstack sudo[94532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:56:11 devstack sudo[94532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:56:12 devstack sudo[94532]: pam_unix(sudo:session): session closed for user root Aug 26 02:56:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.315s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:56:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0c3c9d0d-9006-41b1-91d7-4e48d75a9813 None None] Driver post RPC initialization completed successfully. Aug 26 02:56:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:56:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 6 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:56:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:56:20 devstack cinder-volume[94205]: DEBUG dbcounter [-] [94205] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94205) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:21 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:56:22 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:20 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:57:20 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:21 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 1.075s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:21 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:57:21 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:57:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 6 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:57:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:57:24 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:57:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Flow 'volume_create_manager' (fdd9ed08-57fb-4eaf-9d60-f1512c035c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaa4e60-fbc6-454a-b618-8722072902d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaa4e60-fbc6-454a-b618-8722072902d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-14282156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ee201e-55aa-4055-9fac-2d9715e41105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1e3147358448b4b0bc4f3497cfbc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:24Z,use_quota=True,user_id='4773514d803f4c48afa03de2dc4ca540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2d95a6-3c0b-4875-ac00-3becd4bbac90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b2d95a6-3c0b-4875-ac00-3becd4bbac90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbadf7d-9eb7-4c9a-a2ef-149348898deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdbadf7d-9eb7-4c9a-a2ef-149348898deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4ee201e-55aa-4055-9fac-2d9715e41105', 'volume_name': 'volume-a4ee201e-55aa-4055-9fac-2d9715e41105', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ddc261-d2d8-4c19-b6c2-24e20b2fd489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8ddc261-d2d8-4c19-b6c2-24e20b2fd489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783c0111-6fc8-4cdc-a202-9b5e83cf6336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:25 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Volume a4ee201e-55aa-4055-9fac-2d9715e41105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4ee201e-55aa-4055-9fac-2d9715e41105', 'volume_size': 1} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-14282156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4ee201e-55aa-4055-9fac-2d9715e41105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1e3147358448b4b0bc4f3497cfbc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:24Z,use_quota=True,user_id='4773514d803f4c48afa03de2dc4ca540',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Creating volume a4ee201e-55aa-4055-9fac-2d9715e41105 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:57:25 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:57:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:25 devstack sudo[95329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 1073741824 Aug 26 02:57:25 devstack sudo[95329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:26 devstack sudo[95329]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 1073741824" returned: 0 in 1.564s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:27 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 Aug 26 02:57:27 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:27 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105" returned: 0 in 0.566s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (783c0111-6fc8-4cdc-a202-9b5e83cf6336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4ee201e-55aa-4055-9fac-2d9715e41105', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d754a8-8093-41a4-90e4-bafe56a0d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Volume volume-a4ee201e-55aa-4055-9fac-2d9715e41105 (a4ee201e-55aa-4055-9fac-2d9715e41105): created successfully Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d754a8-8093-41a4-90e4-bafe56a0d25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Flow 'volume_create_manager' (fdd9ed08-57fb-4eaf-9d60-f1512c035c95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8387c922-9fbf-4105-ae59-aedceda29c0f tempest-DeleteServersTestJSON-344184046 None] Created volume successfully. Aug 26 02:57:37 devstack cinder-volume[94506]: WARNING py.warnings [req-d4e808f8-14fa-4912-8bad-8e530c400f9e req-e4f59b74-b7aa-4255-bb05-43e209a1f6b0 tempest-DeleteServersTestJSON-344184046 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 26 02:57:37 devstack cinder-volume[94506]: .first() Aug 26 02:57:37 devstack cinder-volume[94506]: Aug 26 02:57:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d4e808f8-14fa-4912-8bad-8e530c400f9e req-e4f59b74-b7aa-4255-bb05-43e209a1f6b0 tempest-DeleteServersTestJSON-344184046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d4e808f8-14fa-4912-8bad-8e530c400f9e req-e4f59b74-b7aa-4255-bb05-43e209a1f6b0 tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d4e808f8-14fa-4912-8bad-8e530c400f9e req-e4f59b74-b7aa-4255-bb05-43e209a1f6b0 tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-d4e808f8-14fa-4912-8bad-8e530c400f9e req-e4f59b74-b7aa-4255-bb05-43e209a1f6b0 tempest-DeleteServersTestJSON-344184046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-a4ee201e-55aa-4055-9fac-2d9715e41105', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d6d2181-3f8b-4e43-a4a2-cd86b1e43c16', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:57:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-d4e808f8-14fa-4912-8bad-8e530c400f9e req-e4f59b74-b7aa-4255-bb05-43e209a1f6b0 tempest-DeleteServersTestJSON-344184046 None] attachment_update completed successfully. Aug 26 02:57:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-75293801-1b3e-4787-84ce-ac4b91c221ec req-8c063b71-067e-43b9-b5b4-7cacd97f0e8d tempest-DeleteServersTestJSON-344184046 None] Terminate volume connection completed successfully. Aug 26 02:57:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-75293801-1b3e-4787-84ce-ac4b91c221ec req-8c063b71-067e-43b9-b5b4-7cacd97f0e8d tempest-DeleteServersTestJSON-344184046 None] Deleting attachment 0d6d2181-3f8b-4e43-a4a2-cd86b1e43c16. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:57:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Acquiring lock "cinder-a4ee201e-55aa-4055-9fac-2d9715e41105-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:57:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Lock "cinder-a4ee201e-55aa-4055-9fac-2d9715e41105-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:57:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Acquiring lock "cinder-quobyte-a4ee201e-55aa-4055-9fac-2d9715e41105" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:57:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Lock "cinder-quobyte-a4ee201e-55aa-4055-9fac-2d9715e41105" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:57:47 devstack cinder-volume[94506]: INFO oslo.privsep.daemon [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpehxys95b/privsep.sock'] Aug 26 02:57:47 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpehxys95b/privsep.sock Aug 26 02:57:47 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: Aug 26 02:57:49 devstack cinder-volume[94506]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 26 02:57:50 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:50 devstack cinder-volume[94506]: INFO oslo.privsep.daemon [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Spawned new privsep daemon via rootwrap Aug 26 02:57:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Accepted privsep connection to /tmp/tmpehxys95b/privsep.sock {{(pid=94506) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 26 02:57:50 devstack cinder-volume[94506]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 26 02:57:50 devstack cinder-volume[94506]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 26 02:57:50 devstack cinder-volume[94506]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 26 02:57:50 devstack cinder-volume[94506]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96329 Aug 26 02:57:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6430cbf-f5eb-41b4-a063-2d263b502a7a]: (2,) {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fcfdf8-7fdd-47ec-8e1c-4d2d3ced2079]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:57:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:50 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 Aug 26 02:57:50 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:50 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105" returned: 0 in 0.771s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:50 devstack sudo[96338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105 Aug 26 02:57:50 devstack sudo[96338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:51 devstack sudo[96338]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a4ee201e-55aa-4055-9fac-2d9715e41105" returned: 0 in 0.549s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Lock "cinder-quobyte-a4ee201e-55aa-4055-9fac-2d9715e41105" released by "delete_volume" :: held 3.760s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:57:51 devstack cinder-volume[94506]: WARNING cinder.quota [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:57:51 devstack cinder-volume[94506]: WARNING cinder.quota [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Created reservations ['9f2c2295-addb-4df9-a7b5-7ca8f7aced79', '526b30d3-db94-4ce2-be6e-02b15a10a47d', 'ab252379-8db5-4ea2-9a0e-fc8d31b94be8', '322bcb66-533a-488a-8130-b953f077c668'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:52 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:57:52 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:52 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.562s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:52 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:57:52 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Deleted volume successfully. Aug 26 02:57:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-47ee793f-c2cd-41dc-9d53-0304891e28f1 tempest-DeleteServersTestJSON-344184046 None] Lock "cinder-a4ee201e-55aa-4055-9fac-2d9715e41105-delete_volume" released by "delete_volume" :: held 5.033s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Flow 'volume_create_manager' (bf6235ae-b6a4-497e-9642-235f4a9a21b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9db80d-fbac-4fff-b082-10ed954aca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af9db80d-fbac-4fff-b082-10ed954aca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1763875029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0520cf705f4d60b6a683a5771bc203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:56Z,use_quota=True,user_id='99050dc272804ea79990febaec3d33db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b969da94-31ce-435e-9905-611b65fa01f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b969da94-31ce-435e-9905-611b65fa01f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460bb6cb-b2cc-40ed-876c-8e503d4b1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460bb6cb-b2cc-40ed-876c-8e503d4b1932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30', 'volume_name': 'volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9abc51-d67b-4cf0-9757-88690e6bef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9abc51-d67b-4cf0-9757-88690e6bef35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf4fe5-c037-43b8-baad-3b6d6e2a2173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:56 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Volume 17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30', 'volume_size': 1} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:57:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1763875029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0520cf705f4d60b6a683a5771bc203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:57:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:57:56Z,use_quota=True,user_id='99050dc272804ea79990febaec3d33db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Creating volume 17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:57:56 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:56 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 1073741824 Aug 26 02:57:56 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:56 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 1073741824" returned: 0 in 0.527s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:57:56 devstack sudo[96356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 Aug 26 02:57:56 devstack sudo[96356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:57:56 devstack sudo[96356]: pam_unix(sudo:session): session closed for user root Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ecf4fe5-c037-43b8-baad-3b6d6e2a2173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e572ca22-d260-4f38-8b4a-7d39e694f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:57:56 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Volume volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 (17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30): created successfully Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e572ca22-d260-4f38-8b4a-7d39e694f211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:57:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Flow 'volume_create_manager' (bf6235ae-b6a4-497e-9642-235f4a9a21b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:57:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6a78df86-add6-4edb-b868-c2b99c324094 tempest-ServersNegativeTestJSON-768508857 None] Created volume successfully. Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Flow 'volume_create_manager' (d3c8a7ab-3214-401d-9b4e-c44e209cc4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b1cf0f-0389-4e77-ad33-df6688fc2b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b1cf0f-0389-4e77-ad33-df6688fc2b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1744294291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3536d78e-ae48-4f0b-aac4-e7686ec6c2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0520cf705f4d60b6a683a5771bc203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:00Z,use_quota=True,user_id='99050dc272804ea79990febaec3d33db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdadeb2-b26f-4109-9fe8-6c06267b93af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cdadeb2-b26f-4109-9fe8-6c06267b93af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04839ffa-79e9-485b-8e9f-601c058dbe0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04839ffa-79e9-485b-8e9f-601c058dbe0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3536d78e-ae48-4f0b-aac4-e7686ec6c2fe', 'volume_name': 'volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b55141c-651e-4070-82f3-fbacae638f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b55141c-651e-4070-82f3-fbacae638f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86734d9f-fe20-4ee1-bc22-72eb7def970d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:00 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Volume 3536d78e-ae48-4f0b-aac4-e7686ec6c2fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe', 'volume_size': 1} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1744294291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3536d78e-ae48-4f0b-aac4-e7686ec6c2fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a0520cf705f4d60b6a683a5771bc203',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:00Z,use_quota=True,user_id='99050dc272804ea79990febaec3d33db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Creating volume 3536d78e-ae48-4f0b-aac4-e7686ec6c2fe {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:00 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:00 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe 1073741824 Aug 26 02:58:00 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:00 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe 1073741824" returned: 0 in 0.563s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:00 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe Aug 26 02:58:00 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:01 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86734d9f-fe20-4ee1-bc22-72eb7def970d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6f481e-efe2-4575-9a30-53f17a865b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:01 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Volume volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe (3536d78e-ae48-4f0b-aac4-e7686ec6c2fe): created successfully Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef6f481e-efe2-4575-9a30-53f17a865b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Flow 'volume_create_manager' (d3c8a7ab-3214-401d-9b4e-c44e209cc4e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-dbcc015b-5f69-457b-8786-fe5123e119c0 tempest-ServersNegativeTestJSON-768508857 None] Created volume successfully. Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Flow 'volume_create_manager' (8fa57ee2-8e7a-4b93-bda7-455e0563f8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa5a698-3b11-4a8d-871d-a3247e4b4695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "cinder-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa5a698-3b11-4a8d-871d-a3247e4b4695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-262313003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be5b9aa-f557-40e9-95aa-cdf74b22c214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a83c0c8ca4448bb462abfe201a973f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:04Z,use_quota=True,user_id='857e7b6cbb434da3a449aebb4968268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4fdadf-4185-40d9-955f-43c788262360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4fdadf-4185-40d9-955f-43c788262360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c21328-0975-478d-8e4a-40b2b9d8d764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86c21328-0975-478d-8e4a-40b2b9d8d764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be5b9aa-f557-40e9-95aa-cdf74b22c214', 'volume_name': 'volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc07f54d-b2c4-45d1-9d5d-cdb4dcaaf4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc07f54d-b2c4-45d1-9d5d-cdb4dcaaf4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9493ed0-0e3d-4328-a79f-1c400be783e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:04 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Volume 7be5b9aa-f557-40e9-95aa-cdf74b22c214: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214', 'volume_size': 1} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-262313003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be5b9aa-f557-40e9-95aa-cdf74b22c214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a83c0c8ca4448bb462abfe201a973f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:04Z,use_quota=True,user_id='857e7b6cbb434da3a449aebb4968268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Creating volume 7be5b9aa-f557-40e9-95aa-cdf74b22c214 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:04 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:04 devstack sudo[96417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 1073741824 Aug 26 02:58:04 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "cinder-quobyte-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-quobyte-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023e026-cc9f-4774-8f93-a017f8a43a9c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:04 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe Aug 26 02:58:04 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:05 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe" returned: 0 in 0.562s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:05 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:05 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe Aug 26 02:58:05 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 1073741824" returned: 0 in 0.731s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:05 devstack sudo[96432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 Aug 26 02:58:05 devstack sudo[96432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:05 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe" returned: 0 in 0.492s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-quobyte-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe" released by "delete_volume" :: held 1.131s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:05 devstack sudo[96432]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214" returned: 0 in 0.437s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9493ed0-0e3d-4328-a79f-1c400be783e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52893ad3-7b72-4acd-8535-9b4436631d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Volume volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 (7be5b9aa-f557-40e9-95aa-cdf74b22c214): created successfully Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52893ad3-7b72-4acd-8535-9b4436631d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Flow 'volume_create_manager' (8fa57ee2-8e7a-4b93-bda7-455e0563f8cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cf1fdd1d-ef49-4634-868a-a9e0a9492caa tempest-AttachVolumeTestJSON-1944458600 None] Created volume successfully. Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Created reservations ['a5a1a1f5-616b-47c7-9d97-0915ecbdb184', '78485cc1-fc10-42de-802d-421ba3443fb5', 'ec70cb4e-c991-4f4d-8ff4-5b0c0fb55a0a', '19bd3049-59cf-4a33-8091-e3eb87a1f8ca'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:06 devstack sudo[96445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:58:06 devstack sudo[96445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:06 devstack sudo[96445]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Deleted volume successfully. Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-14ca3268-b798-461a-b45e-687d1c4b1016 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-3536d78e-ae48-4f0b-aac4-e7686ec6c2fe-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "cinder-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "cinder-quobyte-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-quobyte-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[852d9ec5-08ec-4400-a041-86b26b602431]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:07 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 Aug 26 02:58:07 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:07 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:07 devstack sudo[96467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30 Aug 26 02:58:07 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:07 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30" returned: 0 in 0.321s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-quobyte-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30" released by "delete_volume" :: held 0.979s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:07 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Created reservations ['3a0b2ce1-fc63-4614-91b0-200a57bbec2a', '642f9859-ef24-4cee-bdd9-38810450e9fd', '7a920386-05bb-4016-bdcd-671fc385399a', '199c4956-6efc-4731-8a63-f184f39b2668'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:08 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:58:08 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:08 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Deleted volume successfully. Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f2b115b-7abc-4aa6-9ee2-ea9b5a9884b9 tempest-ServersNegativeTestJSON-768508857 None] Lock "cinder-17fcc6bc-c7b9-4a80-9a0c-b2cd7cf0bb30-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-c9388637-9a4b-4c7b-9f1e-b8f530c4d2e3 req-198470e8-7056-4144-8d81-e9e982e563be tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-c9388637-9a4b-4c7b-9f1e-b8f530c4d2e3 req-198470e8-7056-4144-8d81-e9e982e563be tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-c9388637-9a4b-4c7b-9f1e-b8f530c4d2e3 req-198470e8-7056-4144-8d81-e9e982e563be tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-c9388637-9a4b-4c7b-9f1e-b8f530c4d2e3 req-198470e8-7056-4144-8d81-e9e982e563be tempest-AttachVolumeTestJSON-1944458600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24f84c6f-07a0-451a-92ce-92ead15f7858', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:58:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-c9388637-9a4b-4c7b-9f1e-b8f530c4d2e3 req-198470e8-7056-4144-8d81-e9e982e563be tempest-AttachVolumeTestJSON-1944458600 None] attachment_update completed successfully. Aug 26 02:58:18 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=34,cinder:INSERT=8,cinder:UPDATE=41,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:20 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:58:20 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:20 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:58:22 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=38,cinder:SELECT=41,cinder:DELETE=5,cinder:INSERT=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:58:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777a4c97-e3b5-4a5d-bde4-169e19ad9efb tempest-BackendsCapabilitiesAdminTestsJSON-1295197895 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8174476623535, 'free_capacity_gb': 1774.8174476623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94506) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 02:58:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebd5256f-3b14-4986-a360-25016b8ef28e tempest-BackendsCapabilitiesAdminTestsJSON-1295197895 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8174476623535, 'free_capacity_gb': 1774.8174476623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94506) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Flow 'volume_create_manager' (ecdce64f-0681-4292-9ce7-ea3725becbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3628e8e-e521-4eaa-9474-5a241ab20ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3628e8e-e521-4eaa-9474-5a241ab20ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1712268735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c5434b-d238-41cd-bb87-41821969bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8372b514a841b29a3d0a47f7e8bbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:41Z,use_quota=True,user_id='ffba5548e38546618359b6b02fa8a7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3c19a3-174c-4400-9e05-32afb6d4d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3c19a3-174c-4400-9e05-32afb6d4d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5ea64e-1af9-45a4-9819-1fbd14ed517a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5ea64e-1af9-45a4-9819-1fbd14ed517a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34c5434b-d238-41cd-bb87-41821969bc06', 'volume_name': 'volume-34c5434b-d238-41cd-bb87-41821969bc06', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d5f7ca-83a8-4488-958c-7d3ea11512c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59d5f7ca-83a8-4488-958c-7d3ea11512c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e78dc02-3f28-44fb-9533-3b273cd781e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Volume 34c5434b-d238-41cd-bb87-41821969bc06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34c5434b-d238-41cd-bb87-41821969bc06', 'volume_size': 1} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1712268735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c5434b-d238-41cd-bb87-41821969bc06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f8372b514a841b29a3d0a47f7e8bbc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:41Z,use_quota=True,user_id='ffba5548e38546618359b6b02fa8a7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Creating volume 34c5434b-d238-41cd-bb87-41821969bc06 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:41 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:58:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:41 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 1073741824 Aug 26 02:58:41 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:42 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 1073741824" returned: 0 in 0.848s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:42 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 Aug 26 02:58:42 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:42 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06" returned: 0 in 0.384s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e78dc02-3f28-44fb-9533-3b273cd781e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c5434b-d238-41cd-bb87-41821969bc06', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d08edc-55ea-47a8-b1b3-70558537b524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:42 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Volume volume-34c5434b-d238-41cd-bb87-41821969bc06 (34c5434b-d238-41cd-bb87-41821969bc06): created successfully Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d08edc-55ea-47a8-b1b3-70558537b524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Flow 'volume_create_manager' (ecdce64f-0681-4292-9ce7-ea3725becbb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0db44896-e1aa-468e-aa76-649a0002f860 tempest-TaggedAttachmentsTest-1838458769 None] Created volume successfully. Aug 26 02:58:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-281c7076-6025-4de0-98a0-5f0f8ad8a36e tempest-GroupsV314Test-1665180565 None] Group tempest-GroupsV314Test-Group-1720019059: creating Aug 26 02:58:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-281c7076-6025-4de0-98a0-5f0f8ad8a36e tempest-GroupsV314Test-1665180565 None] Group tempest-GroupsV314Test-Group-1720019059: created successfully Aug 26 02:58:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-281c7076-6025-4de0-98a0-5f0f8ad8a36e tempest-GroupsV314Test-1665180565 None] Create group completed successfully. Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Flow 'volume_create_manager' (ed8a9d89-0022-416d-ade3-2c18a69b7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51067d53-4779-4eb7-8cfc-4aadaaf2764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51067d53-4779-4eb7-8cfc-4aadaaf2764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-542859050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1806f507-6fc5-49bf-99c3-f0cfba932040,host='devstack@QuobyteHD#QuobyteHD',id=bb17e4ea-70ba-4e34-b185-53e8bd488a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f537c69dad8646fdb70dc79297893748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:49Z,use_quota=True,user_id='6b123b42380e4854b7b6a8caaa456b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec869342-8ef9-4d13-815e-2f02434e5798),volume_type_id=ec869342-8ef9-4d13-815e-2f02434e5798)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f0a292-679c-40b6-85e0-d9ce828dd800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47f0a292-679c-40b6-85e0-d9ce828dd800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4616e239-e9b6-482c-9356-513a89a33ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4616e239-e9b6-482c-9356-513a89a33ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb17e4ea-70ba-4e34-b185-53e8bd488a58', 'volume_name': 'volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2438f210-df06-4c78-9375-f61fe2a25ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2438f210-df06-4c78-9375-f61fe2a25ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfbad8c-a2e9-4fc8-8893-011ff91d667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Volume bb17e4ea-70ba-4e34-b185-53e8bd488a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58', 'volume_size': 1} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1806f507-6fc5-49bf-99c3-f0cfba932040,created_at=2026-08-26T00:58:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-542859050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1806f507-6fc5-49bf-99c3-f0cfba932040,host='devstack@QuobyteHD#QuobyteHD',id=bb17e4ea-70ba-4e34-b185-53e8bd488a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f537c69dad8646fdb70dc79297893748',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:58:49Z,use_quota=True,user_id='6b123b42380e4854b7b6a8caaa456b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec869342-8ef9-4d13-815e-2f02434e5798),volume_type_id=ec869342-8ef9-4d13-815e-2f02434e5798)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Creating volume bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:58:48 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:58:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:49 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 1073741824 Aug 26 02:58:49 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:49 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 1073741824" returned: 0 in 0.593s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:49 devstack sudo[97482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 Aug 26 02:58:49 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:49 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58" returned: 0 in 0.300s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cfbad8c-a2e9-4fc8-8893-011ff91d667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634c7108-1d80-44d5-9656-84104835e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:58:49 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Volume volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 (bb17e4ea-70ba-4e34-b185-53e8bd488a58): created successfully Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634c7108-1d80-44d5-9656-84104835e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:58:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Flow 'volume_create_manager' (ed8a9d89-0022-416d-ade3-2c18a69b7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:58:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-221905d4-37b8-46ba-b169-8682d4cf1843 tempest-GroupsV314Test-1665180565 None] Created volume successfully. Aug 26 02:58:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:52 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Cloning volume bb17e4ea-70ba-4e34-b185-53e8bd488a58 to volume 8f85a661-16a7-4cf8-b75f-a72a8fb47549 Aug 26 02:58:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Creating offline snapshot 14009db8-3d82-42b7-a434-61dd73b9f3fd of volume bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:58:52 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[29974e3f-433a-4755-ba9a-0491e27cbc30]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:52 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 Aug 26 02:58:52 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:53 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58" returned: 0 in 0.827s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:53 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd 1G Aug 26 02:58:53 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:54 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd 1G" returned: 0 in 0.690s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:54 devstack sudo[97547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd Aug 26 02:58:54 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:54 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd" returned: 0 in 0.387s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:54 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd is being set with open permissions: ugo+rw: NotImplementedError Aug 26 02:58:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:54 devstack sudo[97552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd Aug 26 02:58:54 devstack sudo[97552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:54 devstack sudo[97552]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd" returned: 0 in 0.297s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:55 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info Aug 26 02:58:55 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:55 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:55 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:55 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info Aug 26 02:58:55 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:55 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.info" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Acquiring lock "cinder-quobyte-8f85a661-16a7-4cf8-b75f-a72a8fb47549" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-8f85a661-16a7-4cf8-b75f-a72a8fb47549" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] snapshot: 14009db8-3d82-42b7-a434-61dd73b9f3fd, volume: 8f85a661-16a7-4cf8-b75f-a72a8fb47549, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd004e1-d6b6-4c47-8cac-06a57a122e32]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:55 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd Aug 26 02:58:55 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:56 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd" returned: 0 in 0.554s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:58:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a2e11-ee22-43ee-aff6-f1c3c8ba2e47]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:58:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:56 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 Aug 26 02:58:56 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:58:56 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Aug 26 02:58:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58" returned: 0 in 0.656s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:58:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 02:58:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 02:58:57 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 02:58:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:58:57 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 Aug 26 02:58:57 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-7f04d174-f9f9-4755-af76-389a2cbb8268 req-b950cfdb-2526-4d6e-a150-b813f69792e2 tempest-AttachVolumeTestJSON-1944458600 None] Terminate volume connection completed successfully. Aug 26 02:59:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-7f04d174-f9f9-4755-af76-389a2cbb8268 req-b950cfdb-2526-4d6e-a150-b813f69792e2 tempest-AttachVolumeTestJSON-1944458600 None] Deleting attachment 24f84c6f-07a0-451a-92ce-92ead15f7858. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:59:05 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549" returned: 0 in 8.414s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:05 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58, size 1024.00 MB, duration 8.42 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 02:59:05 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Converted 1024.00 MB image at 121.68 MB/s Aug 26 02:59:05 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 02:59:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:05 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 Aug 26 02:59:05 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:05 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549" returned: 0 in 0.454s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-8f85a661-16a7-4cf8-b75f-a72a8fb47549" released by "_copy_volume_from_snapshot" :: held 10.194s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Acquiring lock "cinder-quobyte-14009db8-3d82-42b7-a434-61dd73b9f3fd" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-14009db8-3d82-42b7-a434-61dd73b9f3fd" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Deleting offline snapshot 14009db8-3d82-42b7-a434-61dd73b9f3fd of volume bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] snapshot_file for this snap is: volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f222b911-3206-40b9-a3c4-551c1d65cbe7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:06 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd Aug 26 02:59:06 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:06 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd" returned: 0 in 0.761s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec1ca66-51ba-4e79-977a-49308a01d522]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:07 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 Aug 26 02:59:07 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:08 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58" returned: 0 in 1.058s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:08 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd Aug 26 02:59:08 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:08 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd" returned: 0 in 0.854s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:08 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd Aug 26 02:59:08 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:09 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58.14009db8-3d82-42b7-a434-61dd73b9f3fd" returned: 0 in 0.352s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-14009db8-3d82-42b7-a434-61dd73b9f3fd" released by "_delete_snapshot" :: held 3.300s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.772s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-945443c8-31fa-4349-a5c2-796792d9a22c tempest-GroupsV314Test-1665180565 None] Create group from source-group-1806f507-6fc5-49bf-99c3-f0cfba932040 completed successfully. Aug 26 02:59:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Acquiring lock "cinder-quobyte-8f85a661-16a7-4cf8-b75f-a72a8fb47549" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-8f85a661-16a7-4cf8-b75f-a72a8fb47549" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a539cf8-0f14-4aa4-ae1c-77574095a235]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:10 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 Aug 26 02:59:10 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:11 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549" returned: 0 in 0.723s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:11 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549 Aug 26 02:59:11 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:11 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8f85a661-16a7-4cf8-b75f-a72a8fb47549" returned: 0 in 0.580s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-8f85a661-16a7-4cf8-b75f-a72a8fb47549" released by "delete_volume" :: held 1.386s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Created reservations ['9bacff3c-1711-4513-a2b1-d428a98b607e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:12 devstack cinder-volume[94506]: WARNING cinder.quota [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1845729717 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1845729717, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:59:12 devstack cinder-volume[94506]: WARNING cinder.quota [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1845729717 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1845729717, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Created reservations ['db084080-ebb0-47c9-9a47-4e9a4a701cc5', '7ce5be30-fccb-4a18-ab3a-9ce51c42530c', '0a3966f5-958d-476e-818e-9f9661e0552a', 'da82a66b-cbf9-41f9-954d-0f6685b525bd'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:12 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:59:12 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:12 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.505s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:12 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1bd0a6ed-21ba-4422-bdb5-492c78aa5fcb tempest-GroupsV314Test-1665180565 None] Delete group completed successfully. Aug 26 02:59:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Acquiring lock "cinder-quobyte-bb17e4ea-70ba-4e34-b185-53e8bd488a58" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-bb17e4ea-70ba-4e34-b185-53e8bd488a58" acquired by "delete_volume" :: waited 0.063s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:14 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a6da25-f419-46fc-90da-83fc2539a26d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:14 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 Aug 26 02:59:14 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:14 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58" returned: 0 in 0.717s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:14 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58 Aug 26 02:59:14 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:15 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bb17e4ea-70ba-4e34-b185-53e8bd488a58" returned: 0 in 0.589s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Lock "cinder-quobyte-bb17e4ea-70ba-4e34-b185-53e8bd488a58" released by "delete_volume" :: held 1.488s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:15 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Created reservations ['4be9f99a-2172-4711-bbbc-9aeb892e01fb'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:15 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Created reservations ['b1e01f0b-a8c4-48b9-bb0f-1f20145ec9ba', '8c85f10e-7dc4-4315-ab80-7b45b6277029', 'e217d887-9167-4995-b997-47dcda5c7307', '9c104c0c-c731-4fa0-8aae-fead6f4ea7ca'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:16 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:59:16 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:16 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.576s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:16 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1e3d1d94-28c0-4248-ad28-6ddc8a757e13 tempest-GroupsV314Test-1665180565 None] Delete group completed successfully. Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:20 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:59:20 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:20 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.497s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 8 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 02:59:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=29,cinder:INSERT=6,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=31,cinder:UPDATE=31,cinder:INSERT=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Flow 'volume_create_manager' (aabb32b3-75c4-428d-b064-cdc8ef3159fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9acc215-8c66-43ea-8027-50eca21016ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9acc215-8c66-43ea-8027-50eca21016ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2006039380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c97bb7-ca56-473e-9148-fae23ea87fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa0eb91e3c4384b752d2740ab9e0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:26Z,use_quota=True,user_id='66c3c25fd17943efb768971191a50713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e19ab0-49a4-4ad5-a4c2-9f8f161e2760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e19ab0-49a4-4ad5-a4c2-9f8f161e2760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42210e3-b894-4973-94e2-7ebdf213c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42210e3-b894-4973-94e2-7ebdf213c06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c97bb7-ca56-473e-9148-fae23ea87fbb', 'volume_name': 'volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1031a8d2-0cfc-4038-a7a0-eed60df1828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1031a8d2-0cfc-4038-a7a0-eed60df1828f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30686270-6ee9-4658-bc43-786e60c8dfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Volume f6c97bb7-ca56-473e-9148-fae23ea87fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb', 'volume_size': 1} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2006039380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c97bb7-ca56-473e-9148-fae23ea87fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1faa0eb91e3c4384b752d2740ab9e0fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:26Z,use_quota=True,user_id='66c3c25fd17943efb768971191a50713',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Creating volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:59:26 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:59:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:26 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb 1073741824 Aug 26 02:59:26 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:27 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb 1073741824" returned: 0 in 0.640s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:27 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb Aug 26 02:59:27 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:27 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb" returned: 0 in 0.575s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30686270-6ee9-4658-bc43-786e60c8dfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b676e0-9c98-41af-a37e-003ea120f882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Volume volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb (f6c97bb7-ca56-473e-9148-fae23ea87fbb): created successfully Aug 26 02:59:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b676e0-9c98-41af-a37e-003ea120f882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Flow 'volume_create_manager' (aabb32b3-75c4-428d-b064-cdc8ef3159fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-20e38ff3-db9e-41ce-8da5-a0e630319234 tempest-SnapshotsActionsTest-1132040017 None] Created volume successfully. Aug 26 02:59:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Creating offline snapshot 21eab874-43fa-4f59-8aea-66be41bcc548 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:29 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbf8121-840b-4c4b-b5cf-620dd98b1a5e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:29 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb Aug 26 02:59:29 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:30 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb" returned: 0 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:30 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 1G Aug 26 02:59:30 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:30 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 1G" returned: 0 in 0.616s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:30 devstack sudo[98092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:30 devstack sudo[98092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:31 devstack sudo[98092]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.636s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:31 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 is being set with open permissions: ugo+rw Aug 26 02:59:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:31 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:31 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:31 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.382s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:32 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info Aug 26 02:59:32 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:32 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info" returned: 0 in 0.505s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:32 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info is being set with open permissions: ugo+rw Aug 26 02:59:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:32 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info Aug 26 02:59:32 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:33 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.info" returned: 0 in 0.602s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.561s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-20b61f80-788d-48e0-8e63-d5d7e02c2f63 tempest-SnapshotsActionsTest-1132040017 None] Create snapshot completed successfully Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Flow 'volume_create_manager' (7d9428e5-103c-4b25-92e3-2eb2839f2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c7a258-b9c0-4946-80fb-450d1daea560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06c7a258-b9c0-4946-80fb-450d1daea560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1663693542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673121c2-4985-40a9-9d30-27419f9261f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6ab1712e3d458bb32fc4670d492f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:33Z,use_quota=True,user_id='df6f718c996c4ad9b3bb132d7aad3568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f4bced-f8ed-46cc-85c0-00e67f3b1301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f4bced-f8ed-46cc-85c0-00e67f3b1301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af2443b-e17b-4c37-a6d3-ffd3080a9332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af2443b-e17b-4c37-a6d3-ffd3080a9332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673121c2-4985-40a9-9d30-27419f9261f3', 'volume_name': 'volume-673121c2-4985-40a9-9d30-27419f9261f3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93db5c4-ceb6-413f-addc-61f43bfd4f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d93db5c4-ceb6-413f-addc-61f43bfd4f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a8e2b8-cf3a-4f6f-b2ea-c3b8ff11a08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Volume 673121c2-4985-40a9-9d30-27419f9261f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673121c2-4985-40a9-9d30-27419f9261f3', 'volume_size': 1} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T00:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1663693542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673121c2-4985-40a9-9d30-27419f9261f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6ab1712e3d458bb32fc4670d492f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T00:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T00:59:33Z,use_quota=True,user_id='df6f718c996c4ad9b3bb132d7aad3568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Creating volume 673121c2-4985-40a9-9d30-27419f9261f3 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 02:59:33 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 02:59:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:33 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 1073741824 Aug 26 02:59:33 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:34 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 1073741824" returned: 0 in 0.964s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:34 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 Aug 26 02:59:34 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:35 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3" returned: 0 in 0.416s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a8e2b8-cf3a-4f6f-b2ea-c3b8ff11a08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673121c2-4985-40a9-9d30-27419f9261f3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fde99f9-70db-4b68-ac00-dc9b71179110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Creating offline snapshot a6110f2f-45e5-4660-8988-c4be75d32383 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Volume volume-673121c2-4985-40a9-9d30-27419f9261f3 (673121c2-4985-40a9-9d30-27419f9261f3): created successfully Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fde99f9-70db-4b68-ac00-dc9b71179110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Flow 'volume_create_manager' (7d9428e5-103c-4b25-92e3-2eb2839f2e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ba2e21-d5ab-471a-9fe3-adea4eb805a9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-00c1d803-8d85-42e8-8118-6c923863ffdf tempest-VolumesAdminNegativeTest-1378209707 None] Created volume successfully. Aug 26 02:59:35 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:35 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:35 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.616s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:35 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 1G Aug 26 02:59:35 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Acquiring lock "cinder-673121c2-4985-40a9-9d30-27419f9261f3-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Lock "cinder-673121c2-4985-40a9-9d30-27419f9261f3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Acquiring lock "cinder-quobyte-673121c2-4985-40a9-9d30-27419f9261f3" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Lock "cinder-quobyte-673121c2-4985-40a9-9d30-27419f9261f3" acquired by "delete_volume" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bd08e3-6742-49cd-9a98-d4057e95ab16]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:36 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 1G" returned: 0 in 0.854s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:36 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 Aug 26 02:59:36 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:36 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 Aug 26 02:59:36 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:37 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3" returned: 0 in 0.576s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:37 devstack sudo[98149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3 Aug 26 02:59:37 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:37 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383" returned: 0 in 0.545s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:37 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 is being set with open permissions: ugo+rw Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:37 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 Aug 26 02:59:37 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:37 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-673121c2-4985-40a9-9d30-27419f9261f3" returned: 0 in 0.382s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Lock "cinder-quobyte-673121c2-4985-40a9-9d30-27419f9261f3" released by "delete_volume" :: held 1.058s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:37 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Created reservations ['dc381756-ba6a-4a1b-a329-f12a80697f91', 'f36a7ef6-f1a1-4536-a155-8644ba93d52f', 'f26308cc-2826-4828-a941-6cb09e2d56d7', '97871575-7d7b-4e67-ac7f-462681f31503'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:38 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:59:38 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:38 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383" returned: 0 in 0.912s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.258s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f087d91c-f638-452d-b357-0dc56d689b58 tempest-SnapshotsActionsTest-1132040017 None] Create snapshot completed successfully Aug 26 02:59:38 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.809s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Deleted volume successfully. Aug 26 02:59:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7a040268-621d-44e2-b8b0-456ac6a9da6a tempest-VolumesAdminNegativeTest-1378209707 None] Lock "cinder-673121c2-4985-40a9-9d30-27419f9261f3-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-a6110f2f-45e5-4660-8988-c4be75d32383-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-a6110f2f-45e5-4660-8988-c4be75d32383-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" acquired by "delete_snapshot" :: waited 0.049s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-a6110f2f-45e5-4660-8988-c4be75d32383" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-a6110f2f-45e5-4660-8988-c4be75d32383" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Deleting offline snapshot a6110f2f-45e5-4660-8988-c4be75d32383 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] snapshot_file for this snap is: volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7eef6-99f0-4cc1-8cfe-aba9892e5ffc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:40 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 Aug 26 02:59:40 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:40 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383" returned: 0 in 0.635s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d426d15-c424-41a2-a9b0-70b9df652c34]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:41 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:41 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-23d3a2b0-cebc-4001-9b71-3991be6181fe req-4b2d57e3-10ea-40eb-a773-0852f2fbde2f tempest-TaggedAttachmentsTest-1838458769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-23d3a2b0-cebc-4001-9b71-3991be6181fe req-4b2d57e3-10ea-40eb-a773-0852f2fbde2f tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-23d3a2b0-cebc-4001-9b71-3991be6181fe req-4b2d57e3-10ea-40eb-a773-0852f2fbde2f tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-23d3a2b0-cebc-4001-9b71-3991be6181fe req-4b2d57e3-10ea-40eb-a773-0852f2fbde2f tempest-TaggedAttachmentsTest-1838458769 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-34c5434b-d238-41cd-bb87-41821969bc06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24dd3063-cd47-4ac5-bb8e-05d8a196aeb2', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 02:59:41 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.836s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:41 devstack sudo[98258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 Aug 26 02:59:41 devstack sudo[98258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-23d3a2b0-cebc-4001-9b71-3991be6181fe req-4b2d57e3-10ea-40eb-a773-0852f2fbde2f tempest-TaggedAttachmentsTest-1838458769 None] attachment_update completed successfully. Aug 26 02:59:42 devstack sudo[98258]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383" returned: 0 in 0.592s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:42 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383 Aug 26 02:59:42 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:42 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.a6110f2f-45e5-4660-8988-c4be75d32383" returned: 0 in 0.289s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-a6110f2f-45e5-4660-8988-c4be75d32383" released by "_delete_snapshot" :: held 2.622s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" released by "delete_snapshot" :: held 2.682s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:42 devstack cinder-volume[94506]: WARNING cinder.quota [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Created reservations ['dd56c251-08f0-412c-9c4e-8f9d78fd2aec', '81766da8-2a9d-4392-8d61-6c6076e30e6e', '11226eaa-7c15-41cb-92da-2a244736cb78', 'bd1660f8-1fab-4944-8c98-0c643bdefe8f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Delete snapshot completed successfully. Aug 26 02:59:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4486365d-4f53-4082-939a-584393203c8f tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-a6110f2f-45e5-4660-8988-c4be75d32383-delete_snapshot" released by "delete_snapshot" :: held 3.017s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Creating offline snapshot efcf7671-f934-45e6-ad95-88958cc174c2 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2305dda-ea31-4f55-860e-d88e14b721e6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:43 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:43 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:44 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.380s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:44 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 1G Aug 26 02:59:44 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:44 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 1G" returned: 0 in 0.554s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:44 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 Aug 26 02:59:44 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-7dc36004-52e8-4a13-b486-4f7c076554de req-f1f7193c-fa32-45fb-a066-83387a3d2da7 tempest-TaggedAttachmentsTest-1838458769 None] Terminate volume connection completed successfully. Aug 26 02:59:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-7dc36004-52e8-4a13-b486-4f7c076554de req-f1f7193c-fa32-45fb-a066-83387a3d2da7 tempest-TaggedAttachmentsTest-1838458769 None] Deleting attachment 24dd3063-cd47-4ac5-bb8e-05d8a196aeb2. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 02:59:45 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2" returned: 0 in 0.421s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:45 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 is being set with open permissions: ugo+rw Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:45 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 Aug 26 02:59:45 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:45 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2" returned: 0 in 0.336s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.839s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f08c4b9d-5f76-41b2-8e6e-20f775246f7d tempest-SnapshotsActionsTest-1132040017 None] Create snapshot completed successfully Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-efcf7671-f934-45e6-ad95-88958cc174c2-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-efcf7671-f934-45e6-ad95-88958cc174c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" acquired by "delete_snapshot" :: waited 0.091s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-efcf7671-f934-45e6-ad95-88958cc174c2" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-efcf7671-f934-45e6-ad95-88958cc174c2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Deleting offline snapshot efcf7671-f934-45e6-ad95-88958cc174c2 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] snapshot_file for this snap is: volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cce2d6-b96b-41f7-a6fe-eec5cf720f18]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:46 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 Aug 26 02:59:46 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:46 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2" returned: 0 in 0.525s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4db89b-ab70-41dd-a6b2-00a6adea9ab6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:46 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:46 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:47 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.492s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:47 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 Aug 26 02:59:47 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:47 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2" returned: 0 in 0.631s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:47 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2 Aug 26 02:59:47 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:48 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.efcf7671-f934-45e6-ad95-88958cc174c2" returned: 0 in 0.442s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-efcf7671-f934-45e6-ad95-88958cc174c2" released by "_delete_snapshot" :: held 2.289s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" released by "delete_snapshot" :: held 2.327s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:48 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Created reservations ['33d397ab-5936-4b14-9225-77a3f9402906', '64682c0a-e92c-4999-a4e4-eac8dd7e4c88', '7b6799ae-8543-48de-85fc-85b9f2afb20f', 'f80a5773-fc29-4b9a-8581-cc1cf0070b51'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Delete snapshot completed successfully. Aug 26 02:59:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1f9254b0-4b01-48f4-9ff7-0d1f738ddf20 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-efcf7671-f934-45e6-ad95-88958cc174c2-delete_snapshot" released by "delete_snapshot" :: held 2.617s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Creating offline snapshot 7a710648-21f8-4949-b875-cb17bb6f5ca5 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0db0228-02dd-46d4-a4d6-7a66cab5c53e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:49 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:49 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:50 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.699s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:50 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 1G Aug 26 02:59:50 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:51 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 1G" returned: 0 in 0.802s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:51 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 Aug 26 02:59:51 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:51 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5" returned: 0 in 0.451s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:51 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 is being set with open permissions: ugo+rw Aug 26 02:59:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:51 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 Aug 26 02:59:51 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:52 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5" returned: 0 in 0.320s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.423s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:52 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e822119f-5c83-424a-801e-ef6a36671848 tempest-SnapshotsActionsTest-1132040017 None] Create snapshot completed successfully Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-7a710648-21f8-4949-b875-cb17bb6f5ca5-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-7a710648-21f8-4949-b875-cb17bb6f5ca5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-7a710648-21f8-4949-b875-cb17bb6f5ca5" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-7a710648-21f8-4949-b875-cb17bb6f5ca5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Deleting offline snapshot 7a710648-21f8-4949-b875-cb17bb6f5ca5 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] snapshot_file for this snap is: volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c0328c-77ad-45ad-8169-8b880560fb63]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:53 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 Aug 26 02:59:53 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:53 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5" returned: 0 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1777c193-abb3-4bef-a351-85b49cf2f8e2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:54 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:54 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:54 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.531s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:54 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 Aug 26 02:59:54 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:54 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5" returned: 0 in 0.527s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:54 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5 Aug 26 02:59:54 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:55 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.7a710648-21f8-4949-b875-cb17bb6f5ca5" returned: 0 in 0.372s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-7a710648-21f8-4949-b875-cb17bb6f5ca5" released by "_delete_snapshot" :: held 2.101s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" released by "delete_snapshot" :: held 2.131s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:55 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Created reservations ['72e24440-53fe-450f-807b-12e47da41673', '2ce054b8-71f0-432a-82f2-26504f1f9c4a', 'f89cc11c-9877-4c2e-bdda-a1d8ae5a8653', 'c5ca722e-975a-46a8-bc0e-6449eddcc2af'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Delete snapshot completed successfully. Aug 26 02:59:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-02c6bb32-b789-4ad2-bf82-afb4af43c1ea tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-7a710648-21f8-4949-b875-cb17bb6f5ca5-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Acquiring lock "cinder-34c5434b-d238-41cd-bb87-41821969bc06-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Lock "cinder-34c5434b-d238-41cd-bb87-41821969bc06-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Acquiring lock "cinder-quobyte-34c5434b-d238-41cd-bb87-41821969bc06" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 02:59:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Lock "cinder-quobyte-34c5434b-d238-41cd-bb87-41821969bc06" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 02:59:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed04bf4-d7bd-4448-8e0a-fb61edb8f920]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:56 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 Aug 26 02:59:56 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Creating offline snapshot 398c361d-bd1f-4a11-a792-065b5dc74d82 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a36e27e-cae2-42a7-9bb1-f34a6d4707c4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:57 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06" returned: 0 in 0.800s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:57 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06 Aug 26 02:59:57 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:57 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 02:59:57 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:57 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34c5434b-d238-41cd-bb87-41821969bc06" returned: 0 in 0.460s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Lock "cinder-quobyte-34c5434b-d238-41cd-bb87-41821969bc06" released by "delete_volume" :: held 1.353s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:57 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.629s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 02:59:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:58 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 1G Aug 26 02:59:58 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Created reservations ['bcdf3a00-ee1f-4b07-a443-d1e13c93a7a3', '24224a70-81d4-42d3-a5d4-28585bd56523', 'b12d83cd-ae4a-4219-9463-e6bfa95458d2', '40e9c9c6-15fd-458d-93b6-4d81f11c2db3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:58 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 02:59:58 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:58 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 02:59:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Deleted volume successfully. Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-602af519-fa1f-46b3-b95b-547d6360ecb6 tempest-TaggedAttachmentsTest-1838458769 None] Lock "cinder-34c5434b-d238-41cd-bb87-41821969bc06-delete_volume" released by "delete_volume" :: held 2.143s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 02:59:58 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 1G" returned: 0 in 0.820s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:58 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 Aug 26 02:59:58 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:59 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82" returned: 0 in 0.424s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:59 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 is being set with open permissions: ugo+rw Aug 26 02:59:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 02:59:59 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 Aug 26 02:59:59 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 02:59:59 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Aug 26 02:59:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82" returned: 0 in 0.323s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 02:59:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 02:59:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c65ddd54-d3b6-42f5-8b31-e1da1330ca26 tempest-SnapshotsActionsTest-1132040017 None] Create snapshot completed successfully Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-398c361d-bd1f-4a11-a792-065b5dc74d82-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-398c361d-bd1f-4a11-a792-065b5dc74d82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Acquiring lock "cinder-quobyte-398c361d-bd1f-4a11-a792-065b5dc74d82" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-398c361d-bd1f-4a11-a792-065b5dc74d82" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Deleting offline snapshot 398c361d-bd1f-4a11-a792-065b5dc74d82 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] snapshot_file for this snap is: volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed873f7b-5c72-4f5c-a6c7-08e20cb6dbba]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:00 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 Aug 26 03:00:00 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:01 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82" returned: 0 in 0.537s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[10db17f1-c2cd-4be6-8aa4-2d3032cf302a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:01 devstack sudo[98904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 03:00:01 devstack sudo[98904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:01 devstack sudo[98904]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.432s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:00:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:01 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 Aug 26 03:00:01 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:02 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82" returned: 0 in 0.479s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:02 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82 Aug 26 03:00:02 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:02 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.398c361d-bd1f-4a11-a792-065b5dc74d82" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-398c361d-bd1f-4a11-a792-065b5dc74d82" released by "_delete_snapshot" :: held 1.999s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" released by "delete_snapshot" :: held 2.037s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Created reservations ['e46aff19-4ac8-449a-a09b-dd4e059b3dd3', '00858251-9fbe-47bb-9e70-2399c64a9866', '81644033-6f38-4a0b-9a6e-01c2fe1ac275', 'd9987cab-1c7c-4cfa-a167-77094439a291'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Delete snapshot completed successfully. Aug 26 03:00:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-59b3b5b1-50a4-4466-883d-ea5f736c1997 tempest-SnapshotsActionsTest-1450351968 None] Lock "cinder-398c361d-bd1f-4a11-a792-065b5dc74d82-delete_snapshot" released by "delete_snapshot" :: held 2.295s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "cinder-21eab874-43fa-4f59-8aea-66be41bcc548-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-21eab874-43fa-4f59-8aea-66be41bcc548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "cinder-quobyte-21eab874-43fa-4f59-8aea-66be41bcc548" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-quobyte-21eab874-43fa-4f59-8aea-66be41bcc548" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Deleting offline snapshot 21eab874-43fa-4f59-8aea-66be41bcc548 of volume f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] snapshot_file for this snap is: volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18313ba-f5b8-4f79-bba0-258decda49c4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:04 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 03:00:04 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:04 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.420s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[569188b6-6cdb-4515-b7c0-d947c91de891]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:04 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb Aug 26 03:00:04 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:05 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb" returned: 0 in 0.417s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:05 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 03:00:05 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:05 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.418s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:05 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548 Aug 26 03:00:05 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:06 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb.21eab874-43fa-4f59-8aea-66be41bcc548" returned: 0 in 0.434s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-quobyte-21eab874-43fa-4f59-8aea-66be41bcc548" released by "_delete_snapshot" :: held 1.848s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" released by "delete_snapshot" :: held 1.873s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Created reservations ['c7550976-6063-4721-a08d-000dd0edca24', 'b085921c-5038-4dea-9c9e-221e0be33b99', '7ae9d9ad-95fa-4169-ba3f-c5e41be69d70', '7039c2c8-75bf-4e26-9522-265ef0a288e0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Delete snapshot completed successfully. Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a820f3c1-d74b-4f26-bb69-bfdc4c19ef4c tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-21eab874-43fa-4f59-8aea-66be41bcc548-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "cinder-f6c97bb7-ca56-473e-9148-fae23ea87fbb-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-f6c97bb7-ca56-473e-9148-fae23ea87fbb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586eccf-aaff-4ef8-8bfa-7c254491ed1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:07 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb Aug 26 03:00:07 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:07 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb" returned: 0 in 0.556s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:07 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb Aug 26 03:00:07 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:07 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6c97bb7-ca56-473e-9148-fae23ea87fbb" returned: 0 in 0.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-quobyte-f6c97bb7-ca56-473e-9148-fae23ea87fbb" released by "delete_volume" :: held 0.909s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Created reservations ['cf902d97-c534-4191-a2b6-1cdec21b4912', 'a8d4550e-08f7-4b10-80e1-ffd5bcac4c2b', '57945d43-8945-42a9-9ac8-a7a2d60f5000', '1cc43a98-82ed-41c7-bbb3-3fe13aa26be8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:07 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:07 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:08 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.314s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:08 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Deleted volume successfully. Aug 26 03:00:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d9d21242-21bb-403f-b3e2-b58f9e7f87c4 tempest-SnapshotsActionsTest-1132040017 None] Lock "cinder-f6c97bb7-ca56-473e-9148-fae23ea87fbb-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Flow 'volume_create_manager' (603522f1-31ab-4fee-b75c-d397571bd73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18128436-b201-4f06-9353-57a74d5111ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18128436-b201-4f06-9353-57a74d5111ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-700907226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793a7078-e163-47c1-81c6-81fb5a774fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6576770f86774ab4974cb14396f1e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:18Z,use_quota=True,user_id='ae7a5a5637664932b98abe0cf34b6513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8abee5a-8a35-45fe-9c3b-23fc920cef36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8abee5a-8a35-45fe-9c3b-23fc920cef36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a539c238-67f9-4b39-9139-249ffeb75bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a539c238-67f9-4b39-9139-249ffeb75bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793a7078-e163-47c1-81c6-81fb5a774fcf', 'volume_name': 'volume-793a7078-e163-47c1-81c6-81fb5a774fcf', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31957cd-04d6-4a1c-9646-a5f4de119042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a31957cd-04d6-4a1c-9646-a5f4de119042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f537f1c9-f4fe-46c8-9107-b59365ca9123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:18 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Volume 793a7078-e163-47c1-81c6-81fb5a774fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793a7078-e163-47c1-81c6-81fb5a774fcf', 'volume_size': 1} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-700907226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793a7078-e163-47c1-81c6-81fb5a774fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6576770f86774ab4974cb14396f1e25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:18Z,use_quota=True,user_id='ae7a5a5637664932b98abe0cf34b6513',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Creating volume 793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:18 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:18 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf 1073741824 Aug 26 03:00:18 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:19 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf 1073741824" returned: 0 in 0.978s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:19 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf Aug 26 03:00:19 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:19 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf" returned: 0 in 0.365s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f537f1c9-f4fe-46c8-9107-b59365ca9123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793a7078-e163-47c1-81c6-81fb5a774fcf', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3683b46b-0268-4ed1-9e4b-c81a6d48cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Volume volume-793a7078-e163-47c1-81c6-81fb5a774fcf (793a7078-e163-47c1-81c6-81fb5a774fcf): created successfully Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3683b46b-0268-4ed1-9e4b-c81a6d48cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Flow 'volume_create_manager' (603522f1-31ab-4fee-b75c-d397571bd73c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-499692fd-1b95-4017-856f-cea74617a3c1 req-f3d0e823-8dae-445e-83af-7e692532bcc8 tempest-VolumesSnapshotsTestJSON-670032712 None] Created volume successfully. Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:20 devstack sudo[99093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:20 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:20 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.391s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 8 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:00:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Creating offline snapshot b08e8b7e-012f-40c5-ba1e-5577e6856bbc of volume 793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cbbcad-6554-4b1e-a381-212db034694c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:21 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf Aug 26 03:00:21 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:21 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf" returned: 0 in 0.714s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:21 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc 1G Aug 26 03:00:21 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:22 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc 1G" returned: 0 in 0.919s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793a7078-e163-47c1-81c6-81fb5a774fcf -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:22 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793a7078-e163-47c1-81c6-81fb5a774fcf -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc Aug 26 03:00:22 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:23 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793a7078-e163-47c1-81c6-81fb5a774fcf -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc" returned: 0 in 0.540s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:23 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc is being set with open permissions: ugo+rw Aug 26 03:00:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:23 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc Aug 26 03:00:23 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:23 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc" returned: 0 in 0.482s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:23 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info Aug 26 03:00:23 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:24 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info" returned: 0 in 0.523s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:24 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info is being set with open permissions: ugo+rw Aug 26 03:00:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:24 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info Aug 26 03:00:24 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:24 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.info" returned: 0 in 0.427s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.825s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:24 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-3af3f7cf-12f0-44f3-ac72-0bc603e6abce req-c171e3f3-1c4d-432e-9f1e-f50905f14278 tempest-VolumesSnapshotsTestJSON-670032712 None] Create snapshot completed successfully Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "cinder-b08e8b7e-012f-40c5-ba1e-5577e6856bbc-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-b08e8b7e-012f-40c5-ba1e-5577e6856bbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "cinder-quobyte-793a7078-e163-47c1-81c6-81fb5a774fcf" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-quobyte-793a7078-e163-47c1-81c6-81fb5a774fcf" acquired by "delete_snapshot" :: waited 0.048s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "cinder-quobyte-b08e8b7e-012f-40c5-ba1e-5577e6856bbc" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-quobyte-b08e8b7e-012f-40c5-ba1e-5577e6856bbc" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Deleting offline snapshot b08e8b7e-012f-40c5-ba1e-5577e6856bbc of volume 793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] snapshot_file for this snap is: volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7635ceef-2103-4bfb-8a1a-fe845dd351c2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:25 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc Aug 26 03:00:25 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:26 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc" returned: 0 in 0.602s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793a7078-e163-47c1-81c6-81fb5a774fcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:00:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ecf98cc-05d8-48cc-84c1-8b4c96524925]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:26 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf Aug 26 03:00:26 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:27 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf" returned: 0 in 0.679s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:27 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc Aug 26 03:00:27 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:27 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc" returned: 0 in 0.781s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:27 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc Aug 26 03:00:27 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:28 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf.b08e8b7e-012f-40c5-ba1e-5577e6856bbc" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=79,cinder:INSERT=22,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=69,cinder:SELECT=62,cinder:DELETE=8,cinder:INSERT=15 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-quobyte-b08e8b7e-012f-40c5-ba1e-5577e6856bbc" released by "_delete_snapshot" :: held 2.727s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-quobyte-793a7078-e163-47c1-81c6-81fb5a774fcf" released by "delete_snapshot" :: held 2.797s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG cinder.quota [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Created reservations ['258385b5-4791-4d0b-b70f-9c30ea5e5603', '631e8dd8-05c4-4199-8fec-34fc344c6662', 'ef8fe75f-2658-4f1a-abb0-3cbc97728c11', '78c0ac94-a925-408b-8cfd-9b7a45790890'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Delete snapshot completed successfully. Aug 26 03:00:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-d74db149-c55e-479e-8392-ce046ff2240b req-e1f961e0-35fa-4bba-9335-ba0ef09f9918 tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-b08e8b7e-012f-40c5-ba1e-5577e6856bbc-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "cinder-793a7078-e163-47c1-81c6-81fb5a774fcf-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-793a7078-e163-47c1-81c6-81fb5a774fcf-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "cinder-quobyte-793a7078-e163-47c1-81c6-81fb5a774fcf" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-quobyte-793a7078-e163-47c1-81c6-81fb5a774fcf" acquired by "delete_volume" :: waited 0.055s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:29 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b803ab46-8b4f-4de0-bb92-d102b2e4c5d0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:29 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf Aug 26 03:00:29 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:30 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf" returned: 0 in 0.680s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:30 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf Aug 26 03:00:30 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:30 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-793a7078-e163-47c1-81c6-81fb5a774fcf" returned: 0 in 0.560s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-quobyte-793a7078-e163-47c1-81c6-81fb5a774fcf" released by "delete_volume" :: held 1.404s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:30 devstack cinder-volume[94506]: DEBUG cinder.quota [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Created reservations ['d6d4bed4-f9f3-4b3e-915f-42140a88ffc6', '00718d5b-e004-4252-8d99-b841563d388b', 'dcd21395-f21d-4e7e-bf3f-7809faaf28f5', '59db9853-9894-4256-959e-a6f24fb7f1e5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:31 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:31 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:31 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.482s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG cinder.manager [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:31 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Deleted volume successfully. Aug 26 03:00:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-bac4a8ec-5286-4fc0-b8c4-6efa887afbb9 req-3ac1508b-4366-452c-a630-ea3a814d369c tempest-VolumesSnapshotsTestJSON-670032712 None] Lock "cinder-793a7078-e163-47c1-81c6-81fb5a774fcf-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Flow 'volume_create_manager' (7587f1ba-404b-45e4-9284-41054a7b89ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19939f7-4f5a-4f28-9611-c4a5fffcf004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19939f7-4f5a-4f28-9611-c4a5fffcf004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1777884576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ea119e-9c3b-4b74-85b8-fdd0d7510a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3c82bd41924aa6ab6c924982150f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:35Z,use_quota=True,user_id='677dcd54db104db2921794b2fc31ff95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5833c81-a560-4516-a677-f669ca8b33ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5833c81-a560-4516-a677-f669ca8b33ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a603f09-182b-4207-8d10-71938c1cd3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a603f09-182b-4207-8d10-71938c1cd3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ea119e-9c3b-4b74-85b8-fdd0d7510a34', 'volume_name': 'volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b46e9fc-267b-4395-a218-164f4b63cb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b46e9fc-267b-4395-a218-164f4b63cb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc4c7c5-f3b0-494a-a251-9ed927f8eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:34 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Volume c1ea119e-9c3b-4b74-85b8-fdd0d7510a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34', 'volume_size': 1} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1777884576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1ea119e-9c3b-4b74-85b8-fdd0d7510a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3c82bd41924aa6ab6c924982150f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:35Z,use_quota=True,user_id='677dcd54db104db2921794b2fc31ff95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Creating volume c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:34 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:34 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 1073741824 Aug 26 03:00:34 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:35 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 1073741824" returned: 0 in 0.842s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:35 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 Aug 26 03:00:35 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:36 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34" returned: 0 in 0.451s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bc4c7c5-f3b0-494a-a251-9ed927f8eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f276b017-a7f0-4b29-b8a1-a3423fcacd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Volume volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 (c1ea119e-9c3b-4b74-85b8-fdd0d7510a34): created successfully Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f276b017-a7f0-4b29-b8a1-a3423fcacd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Flow 'volume_create_manager' (7587f1ba-404b-45e4-9284-41054a7b89ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-92575f62-8f47-463a-bfa7-785a0334b983 tempest-VolumesListAdminTestJSON-575685699 None] Created volume successfully. Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Flow 'volume_create_manager' (a5b9d8e1-f0a7-4b00-98e4-25db0607ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd75563-affd-41f4-9d47-5b8ef73c6e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd75563-affd-41f4-9d47-5b8ef73c6e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1121519069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c31cc7-1c68-422d-a882-7976ed7fd58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3c82bd41924aa6ab6c924982150f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:37Z,use_quota=True,user_id='677dcd54db104db2921794b2fc31ff95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711e40be-f141-4cc5-9a94-5f00ea373382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (711e40be-f141-4cc5-9a94-5f00ea373382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014ced0d-55f0-4b69-9f02-7abb0f65da37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014ced0d-55f0-4b69-9f02-7abb0f65da37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2c31cc7-1c68-422d-a882-7976ed7fd58f', 'volume_name': 'volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06316f8-521f-414a-8284-9a6ba63b8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06316f8-521f-414a-8284-9a6ba63b8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478f6f06-4cfb-460f-94e9-102ffa022b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Volume a2c31cc7-1c68-422d-a882-7976ed7fd58f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f', 'volume_size': 1} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1121519069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c31cc7-1c68-422d-a882-7976ed7fd58f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3c82bd41924aa6ab6c924982150f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:37Z,use_quota=True,user_id='677dcd54db104db2921794b2fc31ff95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Creating volume a2c31cc7-1c68-422d-a882-7976ed7fd58f {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:37 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:37 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f 1073741824 Aug 26 03:00:37 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:38 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f 1073741824" returned: 0 in 0.572s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:38 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f Aug 26 03:00:38 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:38 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f" returned: 0 in 0.296s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (478f6f06-4cfb-460f-94e9-102ffa022b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabbc284-ac5b-4afb-98fc-5357f70fc1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Volume volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f (a2c31cc7-1c68-422d-a882-7976ed7fd58f): created successfully Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fabbc284-ac5b-4afb-98fc-5357f70fc1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Flow 'volume_create_manager' (a5b9d8e1-f0a7-4b00-98e4-25db0607ec29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-868b7a91-8edb-4aa3-8e34-ee0e940a264b tempest-VolumesListAdminTestJSON-575685699 None] Created volume successfully. Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Flow 'volume_create_manager' (fe647068-4f2c-425b-89a7-b9d644188d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c791cf2-0489-4d68-b8d8-f0126e80c7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c791cf2-0489-4d68-b8d8-f0126e80c7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-947025806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf00c8b0-7a84-471e-b521-f660ea345d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3c82bd41924aa6ab6c924982150f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:40Z,use_quota=True,user_id='677dcd54db104db2921794b2fc31ff95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1790f5e-bb80-40eb-a88b-cb73bcc56c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1790f5e-bb80-40eb-a88b-cb73bcc56c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f745e3-bba1-483d-a979-d453d3053ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f745e3-bba1-483d-a979-d453d3053ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf00c8b0-7a84-471e-b521-f660ea345d8e', 'volume_name': 'volume-cf00c8b0-7a84-471e-b521-f660ea345d8e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f63c434-0ce4-4b12-849d-d4d185bfa6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f63c434-0ce4-4b12-849d-d4d185bfa6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93c4e80-44c2-498a-bd09-847d76aa30f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Volume cf00c8b0-7a84-471e-b521-f660ea345d8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf00c8b0-7a84-471e-b521-f660ea345d8e', 'volume_size': 1} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-947025806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf00c8b0-7a84-471e-b521-f660ea345d8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e3c82bd41924aa6ab6c924982150f0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:40Z,use_quota=True,user_id='677dcd54db104db2921794b2fc31ff95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Creating volume cf00c8b0-7a84-471e-b521-f660ea345d8e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:40 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:40 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e 1073741824 Aug 26 03:00:40 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:40 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e 1073741824" returned: 0 in 0.520s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:41 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e Aug 26 03:00:41 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:41 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e" returned: 0 in 0.302s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c93c4e80-44c2-498a-bd09-847d76aa30f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf00c8b0-7a84-471e-b521-f660ea345d8e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b32ff6b-e2f2-4a8d-8208-f279d23726f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Volume volume-cf00c8b0-7a84-471e-b521-f660ea345d8e (cf00c8b0-7a84-471e-b521-f660ea345d8e): created successfully Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b32ff6b-e2f2-4a8d-8208-f279d23726f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Flow 'volume_create_manager' (fe647068-4f2c-425b-89a7-b9d644188d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-56e19704-b51b-4e63-880f-9f36974bfd44 tempest-VolumesListAdminTestJSON-575685699 None] Created volume successfully. Aug 26 03:00:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1124bbe3-1077-4c37-8495-076500b62276 tempest-GroupSnapshotsTest-1617530097 None] Group tempest-GroupSnapshotsTest-Group-748050967: creating Aug 26 03:00:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1124bbe3-1077-4c37-8495-076500b62276 tempest-GroupSnapshotsTest-1617530097 None] Group tempest-GroupSnapshotsTest-Group-748050967: created successfully Aug 26 03:00:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1124bbe3-1077-4c37-8495-076500b62276 tempest-GroupSnapshotsTest-1617530097 None] Create group completed successfully. Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Flow 'volume_create_manager' (ca17e04c-749e-4047-b50c-67ddea6503ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebc3fa0-5946-4138-8ecd-d5fb9baccc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ebc3fa0-5946-4138-8ecd-d5fb9baccc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f2c40d-0a90-4a54-94e1-3efd2e126240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b325c7611c4327a2b707f5649e39ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:44Z,use_quota=True,user_id='4e83208a5e174a4d948c805d409c3f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4080d5e6-c535-4bd7-9af6-58f54fcde953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4080d5e6-c535-4bd7-9af6-58f54fcde953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e867f18-d063-4369-8435-73364b0a3c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e867f18-d063-4369-8435-73364b0a3c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f2c40d-0a90-4a54-94e1-3efd2e126240', 'volume_name': 'volume-13f2c40d-0a90-4a54-94e1-3efd2e126240', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e940f8-641e-4949-b064-b908e15b68fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e940f8-641e-4949-b064-b908e15b68fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ebb751-7530-4c18-b0d6-11c3c5914b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:43 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Volume 13f2c40d-0a90-4a54-94e1-3efd2e126240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f2c40d-0a90-4a54-94e1-3efd2e126240', 'volume_size': 1} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f2c40d-0a90-4a54-94e1-3efd2e126240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35b325c7611c4327a2b707f5649e39ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:44Z,use_quota=True,user_id='4e83208a5e174a4d948c805d409c3f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Creating volume 13f2c40d-0a90-4a54-94e1-3efd2e126240 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:43 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:43 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 1073741824 Aug 26 03:00:43 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:44 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 1073741824" returned: 0 in 0.744s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:44 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 Aug 26 03:00:44 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:45 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240" returned: 0 in 0.375s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ebb751-7530-4c18-b0d6-11c3c5914b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f2c40d-0a90-4a54-94e1-3efd2e126240', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0ee2fb-2f37-4560-b3b0-ee9e2e2de70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:45 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Volume volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 (13f2c40d-0a90-4a54-94e1-3efd2e126240): created successfully Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc0ee2fb-2f37-4560-b3b0-ee9e2e2de70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Flow 'volume_create_manager' (ca17e04c-749e-4047-b50c-67ddea6503ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-614b91ec-9ea3-4a32-875c-5f4fa888819c tempest-VolumesListAdminTestJSON-1663536425 None] Created volume successfully. Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (486103e4-ac7c-473d-aa09-45fd69d12f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e52177-2071-4851-beaa-24dd75b13e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e52177-2071-4851-beaa-24dd75b13e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861553974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdd5c525-b714-4aaf-9a53-1f2c1f3d1843,host='devstack@QuobyteHD#QuobyteHD',id=5ffab8c4-2d9e-4cac-8775-42cc0b20349f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:45Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce4d7fcd-82c9-479f-bbe9-51bc9d5bca2d),volume_type_id=ce4d7fcd-82c9-479f-bbe9-51bc9d5bca2d)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a378a79-0b9a-433c-8823-5fb769ced34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a378a79-0b9a-433c-8823-5fb769ced34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5326cbf6-517a-4fd2-8a3a-fbb21b72ba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5326cbf6-517a-4fd2-8a3a-fbb21b72ba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ffab8c4-2d9e-4cac-8775-42cc0b20349f', 'volume_name': 'volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db151455-8dd6-4001-923f-85ae48c09c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db151455-8dd6-4001-923f-85ae48c09c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af585d44-9098-4b8e-b484-a9b4899c99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:45 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Volume 5ffab8c4-2d9e-4cac-8775-42cc0b20349f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f', 'volume_size': 1} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fdd5c525-b714-4aaf-9a53-1f2c1f3d1843,created_at=2026-08-26T01:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1861553974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fdd5c525-b714-4aaf-9a53-1f2c1f3d1843,host='devstack@QuobyteHD#QuobyteHD',id=5ffab8c4-2d9e-4cac-8775-42cc0b20349f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:45Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce4d7fcd-82c9-479f-bbe9-51bc9d5bca2d),volume_type_id=ce4d7fcd-82c9-479f-bbe9-51bc9d5bca2d)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Creating volume 5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:45 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:45 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f 1073741824 Aug 26 03:00:45 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Acquiring lock "cinder-13f2c40d-0a90-4a54-94e1-3efd2e126240-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Lock "cinder-13f2c40d-0a90-4a54-94e1-3efd2e126240-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Acquiring lock "cinder-quobyte-13f2c40d-0a90-4a54-94e1-3efd2e126240" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Lock "cinder-quobyte-13f2c40d-0a90-4a54-94e1-3efd2e126240" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8c40b2-9952-4a23-8469-0559462cf9fe]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:46 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "cinder-cf00c8b0-7a84-471e-b521-f660ea345d8e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f 1073741824" returned: 0 in 0.754s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-cf00c8b0-7a84-471e-b521-f660ea345d8e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:46 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f Aug 26 03:00:46 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:46 devstack sudo[99275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 Aug 26 03:00:46 devstack sudo[99275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "cinder-quobyte-cf00c8b0-7a84-471e-b521-f660ea345d8e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-quobyte-cf00c8b0-7a84-471e-b521-f660ea345d8e" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7603b26a-a61f-4f0e-9b0b-858921912637]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:46 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e Aug 26 03:00:46 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:46 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" returned: 0 in 0.453s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af585d44-9098-4b8e-b484-a9b4899c99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435ffc60-21c0-4aee-95ba-c264ca141602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Volume volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f (5ffab8c4-2d9e-4cac-8775-42cc0b20349f): created successfully Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (435ffc60-21c0-4aee-95ba-c264ca141602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (486103e4-ac7c-473d-aa09-45fd69d12f18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:46 devstack sudo[99275]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240" returned: 0 in 0.690s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d1732509-e561-45bd-b7d9-b32fd5051ed0 tempest-GroupSnapshotsTest-1617530097 None] Created volume successfully. Aug 26 03:00:47 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240 Aug 26 03:00:47 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:47 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e" returned: 0 in 0.917s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:47 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e Aug 26 03:00:47 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Flow 'volume_create_manager' (38a549f0-46e1-4532-8ccd-0d3a58ba36f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631ea8f9-6d1f-4ce5-b269-ebe11620b979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:47 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (631ea8f9-6d1f-4ce5-b269-ebe11620b979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-479715654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaefe246-84e5-4f87-bd00-08ab2f831fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a83c0c8ca4448bb462abfe201a973f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:47Z,use_quota=True,user_id='857e7b6cbb434da3a449aebb4968268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71510160-706e-4215-8712-d46b6986dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71510160-706e-4215-8712-d46b6986dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570bc390-6a16-4902-a4fa-b9c254847559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (570bc390-6a16-4902-a4fa-b9c254847559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaefe246-84e5-4f87-bd00-08ab2f831fe0', 'volume_name': 'volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbbb93c-bc15-4b20-b5b8-049fb2b73738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dbbb93c-bc15-4b20-b5b8-049fb2b73738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d217009-721c-427e-9ce1-56102a7b12e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Volume aaefe246-84e5-4f87-bd00-08ab2f831fe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0', 'volume_size': 1} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-479715654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaefe246-84e5-4f87-bd00-08ab2f831fe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a83c0c8ca4448bb462abfe201a973f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:47Z,use_quota=True,user_id='857e7b6cbb434da3a449aebb4968268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Creating volume aaefe246-84e5-4f87-bd00-08ab2f831fe0 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:47 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-13f2c40d-0a90-4a54-94e1-3efd2e126240" returned: 0 in 0.823s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Lock "cinder-quobyte-13f2c40d-0a90-4a54-94e1-3efd2e126240" released by "delete_volume" :: held 1.592s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:47 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 1073741824 Aug 26 03:00:47 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Created reservations ['8220f2ce-e1b8-4df6-9f32-2034440ac951', '20db93bb-aba9-46dc-a280-6b32c583799c', '8e610551-1ed9-4dff-a466-461376d3b9c6', 'd5fdefe7-1a67-4a99-9f29-d85b804075af'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:47 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cf00c8b0-7a84-471e-b521-f660ea345d8e" returned: 0 in 0.477s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-quobyte-cf00c8b0-7a84-471e-b521-f660ea345d8e" released by "delete_volume" :: held 1.493s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:48 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:48 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Created reservations ['8acb6d53-2c83-4231-863e-6b590d09246a', '57e57993-2261-4ff2-8619-1489493eea7a', '31c18f03-bcb8-4664-9960-a343e520c026', 'bb72b3e0-5f65-447d-9094-f3e0b5e41380'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:48 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:48 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:48 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.804s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:48 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Deleted volume successfully. Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-64758520-05de-4e46-909b-c84c66c44d66 tempest-VolumesListAdminTestJSON-1663536425 None] Lock "cinder-13f2c40d-0a90-4a54-94e1-3efd2e126240-delete_volume" released by "delete_volume" :: held 2.890s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "cinder-a2c31cc7-1c68-422d-a882-7976ed7fd58f-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 1073741824" returned: 0 in 1.287s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:49 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-a2c31cc7-1c68-422d-a882-7976ed7fd58f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:49 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "cinder-quobyte-a2c31cc7-1c68-422d-a882-7976ed7fd58f" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.675s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Deleted volume successfully. Aug 26 03:00:49 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 Aug 26 03:00:49 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-quobyte-a2c31cc7-1c68-422d-a882-7976ed7fd58f" acquired by "delete_volume" :: waited 0.076s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] GroupSnapshot 3336c524-1e16-4ef0-8bda-d8086c786432: creating. Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9714b78b-661e-4c82-af6b-c06ca3a3e26d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17ace7b3-01f6-4473-b74d-81f6f7168859 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-cf00c8b0-7a84-471e-b521-f660ea345d8e-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Group snapshot 3336c524-1e16-4ef0-8bda-d8086c786432: creating. {{(pid=94506) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:49 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f Aug 26 03:00:49 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:49 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] <== create_volume: return (1790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.211s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Creating offline snapshot f7f5488b-92a7-4077-8650-8f05dfccf3a6 of volume 5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d217009-721c-427e-9ce1-56102a7b12e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891d3548-76d3-48b6-be1a-8c960adf41d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2d7988-94b9-4cde-a96e-a1031d68dc64]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:49 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Volume volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 (aaefe246-84e5-4f87-bd00-08ab2f831fe0): created successfully Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (891d3548-76d3-48b6-be1a-8c960adf41d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Flow 'volume_create_manager' (38a549f0-46e1-4532-8ccd-0d3a58ba36f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-30da14b9-3acb-492a-a5d3-ab62722812da tempest-AttachVolumeTestJSON-1944458600 None] Created volume successfully. Aug 26 03:00:49 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f Aug 26 03:00:49 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:49 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f" returned: 0 in 0.511s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:49 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f Aug 26 03:00:49 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:50 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a2c31cc7-1c68-422d-a882-7976ed7fd58f" returned: 0 in 0.291s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-quobyte-a2c31cc7-1c68-422d-a882-7976ed7fd58f" released by "delete_volume" :: held 0.907s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:50 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" returned: 0 in 0.525s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:50 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 1G Aug 26 03:00:50 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Created reservations ['30582985-c627-45b4-8580-023604c39d96', 'c65a2409-2718-4cdc-ae79-a43506486c1c', '2c3f246a-b27c-43d0-b00b-f205fe24c871', '5e698587-2378-4609-872a-ba2033535f71'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:50 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:50 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:50 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.345s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Deleted volume successfully. Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9211a0a8-dd86-4432-9aee-d28c61400fe9 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-a2c31cc7-1c68-422d-a882-7976ed7fd58f-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:50 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 1G" returned: 0 in 0.756s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:50 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 Aug 26 03:00:50 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:51 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6" returned: 0 in 0.548s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:51 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:51 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 Aug 26 03:00:51 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "cinder-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "cinder-quobyte-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-quobyte-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f47fc-4123-4db3-ba72-290534bc7315]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:51 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6" returned: 0 in 0.490s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:52 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:52 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info Aug 26 03:00:52 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-4b79f07d-c6cb-44c1-ad5b-1fb080509a01 req-91977a12-bec9-4d4f-a5a5-ad5f06625895 tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:52 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34" returned: 0 in 0.496s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:52 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34 Aug 26 03:00:52 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:52 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info" returned: 0 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:52 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info Aug 26 03:00:52 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:52 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34" returned: 0 in 0.422s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-quobyte-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34" released by "delete_volume" :: held 1.043s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:52 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.info" returned: 0 in 0.431s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.384s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-4b79f07d-c6cb-44c1-ad5b-1fb080509a01 req-91977a12-bec9-4d4f-a5a5-ad5f06625895 tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.839s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Created reservations ['46bc13b3-f88e-440d-b736-b16997cc7849', 'c703bb32-cb84-42eb-b504-d8c351c9489c', '63916308-db9d-4da7-b7f9-23086000cd8f', 'fc63e94c-9054-4276-aa8e-caa203361899'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-4b79f07d-c6cb-44c1-ad5b-1fb080509a01 req-91977a12-bec9-4d4f-a5a5-ad5f06625895 tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.140s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-4b79f07d-c6cb-44c1-ad5b-1fb080509a01 req-91977a12-bec9-4d4f-a5a5-ad5f06625895 tempest-AttachVolumeTestJSON-1944458600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1506ebfc-2ab0-4fb4-a75d-90d9c395152a', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:00:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a10229e4-f797-421d-a78b-1468555402c8 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 3336c524-1e16-4ef0-8bda-d8086c786432: created successfully Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:53 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:00:53 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-4b79f07d-c6cb-44c1-ad5b-1fb080509a01 req-91977a12-bec9-4d4f-a5a5-ad5f06625895 tempest-AttachVolumeTestJSON-1944458600 None] attachment_update completed successfully. Aug 26 03:00:53 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.396s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:00:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Deleted volume successfully. Aug 26 03:00:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-88373801-23c0-412d-8a31-0533ca953967 tempest-VolumesListAdminTestJSON-575685699 None] Lock "cinder-c1ea119e-9c3b-4b74-85b8-fdd0d7510a34-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-f7f5488b-92a7-4077-8650-8f05dfccf3a6-504f733b-1197-492e-ab37-760fca4722ec" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-f7f5488b-92a7-4077-8650-8f05dfccf3a6-504f733b-1197-492e-ab37-760fca4722ec" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Creating volume 504f733b-1197-492e-ab37-760fca4722ec from snapshot f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-504f733b-1197-492e-ab37-760fca4722ec" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-504f733b-1197-492e-ab37-760fca4722ec" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] snapshot: f7f5488b-92a7-4077-8650-8f05dfccf3a6, volume: 504f733b-1197-492e-ab37-760fca4722ec, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a7fa05-1bb1-4e1e-a734-db5b10b3490d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:55 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 Aug 26 03:00:55 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:55 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6" returned: 0 in 0.532s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca313d-0897-4aa7-937d-85ef00bda9b9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:00:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:55 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f Aug 26 03:00:55 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:56 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Aug 26 03:00:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:00:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:00:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:00:56 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:00:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:00:56 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec Aug 26 03:00:56 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Flow 'volume_create_manager' (d0b32919-f32c-4320-b3e3-3b754cf2eb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d5e72b-dc4a-422a-8210-69ce9b97efd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d5e72b-dc4a-422a-8210-69ce9b97efd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1018167514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60429ab-7d7f-4eef-9838-349049ecc69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a83c0c8ca4448bb462abfe201a973f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:58Z,use_quota=True,user_id='857e7b6cbb434da3a449aebb4968268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a439a70-159b-438f-83d8-397cfb49e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a439a70-159b-438f-83d8-397cfb49e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39eee7c-6f27-4782-8eeb-d84fb9b6f34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39eee7c-6f27-4782-8eeb-d84fb9b6f34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c60429ab-7d7f-4eef-9838-349049ecc69e', 'volume_name': 'volume-c60429ab-7d7f-4eef-9838-349049ecc69e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e872eae-1ae4-473c-8fd0-5eb0c52e263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e872eae-1ae4-473c-8fd0-5eb0c52e263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e35f07-e9fa-48a5-bcf7-059158606121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:00:58 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Volume c60429ab-7d7f-4eef-9838-349049ecc69e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c60429ab-7d7f-4eef-9838-349049ecc69e', 'volume_size': 1} Aug 26 03:00:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:03 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec" returned: 0 in 7.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:03 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:01:03 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Converted 1024.00 MB image at 137.33 MB/s Aug 26 03:01:03 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:03 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec Aug 26 03:01:03 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:03 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec" returned: 0 in 0.304s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-504f733b-1197-492e-ab37-760fca4722ec" released by "_copy_volume_from_snapshot" :: held 8.846s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-f7f5488b-92a7-4077-8650-8f05dfccf3a6-504f733b-1197-492e-ab37-760fca4722ec" released by "_create_volume_from_snapshot" :: held 8.964s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.704s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1018167514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60429ab-7d7f-4eef-9838-349049ecc69e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a83c0c8ca4448bb462abfe201a973f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:00:58Z,use_quota=True,user_id='857e7b6cbb434da3a449aebb4968268c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Creating volume c60429ab-7d7f-4eef-9838-349049ecc69e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:04 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:04 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e 1073741824 Aug 26 03:01:04 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:04 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-bc6a97a5-79ce-41ae-825b-88490ebe7e1a tempest-GroupSnapshotsTest-1617530097 None] Create group from source-snapshot-3336c524-1e16-4ef0-8bda-d8086c786432 completed successfully. Aug 26 03:01:04 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e 1073741824" returned: 0 in 0.592s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:04 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e Aug 26 03:01:04 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Flow 'volume_create_manager' (c7281e74-c301-4afe-b176-fff7cd330908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c8559f-7c31-4236-befd-a8b1ce769c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10c8559f-7c31-4236-befd-a8b1ce769c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1765408212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608eeb92-fe54-4126-923c-de4f1d45c821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18afc0a804c4493f925f6cec4200ce0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:05Z,use_quota=True,user_id='54053bfdc7554ba98893d13b2fcf34d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92127ae-387f-4284-b83d-3529b02e7ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92127ae-387f-4284-b83d-3529b02e7ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07ee27f-4add-4013-a72e-3fe612648221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e07ee27f-4add-4013-a72e-3fe612648221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '608eeb92-fe54-4126-923c-de4f1d45c821', 'volume_name': 'volume-608eeb92-fe54-4126-923c-de4f1d45c821', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0c1cb9-0b36-40f3-b8fa-e5e51a4a1843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0c1cb9-0b36-40f3-b8fa-e5e51a4a1843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:05 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4235f491-b25d-4f71-a709-22758528abb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Volume 608eeb92-fe54-4126-923c-de4f1d45c821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-608eeb92-fe54-4126-923c-de4f1d45c821', 'volume_size': 1} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1765408212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=608eeb92-fe54-4126-923c-de4f1d45c821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18afc0a804c4493f925f6cec4200ce0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:05Z,use_quota=True,user_id='54053bfdc7554ba98893d13b2fcf34d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Creating volume 608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:05 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e35f07-e9fa-48a5-bcf7-059158606121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60429ab-7d7f-4eef-9838-349049ecc69e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054114d0-f7a2-4eb7-89a4-bf7ba5cc85c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:05 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 1073741824 Aug 26 03:01:05 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Volume volume-c60429ab-7d7f-4eef-9838-349049ecc69e (c60429ab-7d7f-4eef-9838-349049ecc69e): created successfully Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054114d0-f7a2-4eb7-89a4-bf7ba5cc85c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Flow 'volume_create_manager' (d0b32919-f32c-4320-b3e3-3b754cf2eb12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-944325c7-0719-4ec0-900c-ba9f35caa52c tempest-AttachVolumeTestJSON-1944458600 None] Created volume successfully. Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-504f733b-1197-492e-ab37-760fca4722ec" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-504f733b-1197-492e-ab37-760fca4722ec" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[33266014-2594-46e8-8b05-e5993dc3fccd]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:05 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 1073741824" returned: 0 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:05 devstack sudo[99905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 Aug 26 03:01:05 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec Aug 26 03:01:05 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:05 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821" returned: 0 in 0.282s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4235f491-b25d-4f71-a709-22758528abb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-608eeb92-fe54-4126-923c-de4f1d45c821', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbdad63-8150-4028-bd5a-a4ed87c9a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:06 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Volume volume-608eeb92-fe54-4126-923c-de4f1d45c821 (608eeb92-fe54-4126-923c-de4f1d45c821): created successfully Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fbdad63-8150-4028-bd5a-a4ed87c9a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Flow 'volume_create_manager' (c7281e74-c301-4afe-b176-fff7cd330908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:06 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec" returned: 0 in 0.434s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-eaf071f7-42e8-4cb5-819a-0aa138e1046f tempest-SnapshotMetadataTestJSON-180668651 None] Created volume successfully. Aug 26 03:01:06 devstack sudo[99914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec Aug 26 03:01:06 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:06 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-504f733b-1197-492e-ab37-760fca4722ec" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-504f733b-1197-492e-ab37-760fca4722ec" released by "delete_volume" :: held 0.750s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['efeddce4-10e4-40db-8a1f-803f0bef6494'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:06 devstack cinder-volume[94506]: WARNING cinder.quota [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1163379305 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1163379305, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:06 devstack cinder-volume[94506]: WARNING cinder.quota [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1163379305 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1163379305, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['2d65fcac-287c-43f8-a570-f92c30f88107', '0d1d3f05-9e64-42f1-b8c3-415234fc62c0', '97b9c65a-703e-4e44-9b2a-2b15b93c7a04', 'c901948e-b456-4c41-8ba1-9356b348492b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:06 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:06 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 3336c524-1e16-4ef0-8bda-d8086c786432: deleting Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 3336c524-1e16-4ef0-8bda-d8086c786432: deleting {{(pid=94506) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:01:07 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.387s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-89511a88-0506-4b28-9955-e972aba2797e tempest-GroupSnapshotsTest-1617530097 None] Delete group completed successfully. Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-f7f5488b-92a7-4077-8650-8f05dfccf3a6" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-f7f5488b-92a7-4077-8650-8f05dfccf3a6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Deleting offline snapshot f7f5488b-92a7-4077-8650-8f05dfccf3a6 of volume 5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] snapshot_file for this snap is: volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[479643b3-4eb2-4257-8033-e34a7097e9ef]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:07 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 Aug 26 03:01:07 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e9848250-61ef-4fc1-9e15-b0d847322eca req-5fbfae03-7bfb-46a9-b9db-23131ec06806 tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e9848250-61ef-4fc1-9e15-b0d847322eca req-5fbfae03-7bfb-46a9-b9db-23131ec06806 tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e9848250-61ef-4fc1-9e15-b0d847322eca req-5fbfae03-7bfb-46a9-b9db-23131ec06806 tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Creating offline snapshot ff96c590-4536-4f4a-9f25-842784bc61dc of volume 608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5c5899-d13c-49b3-b2ae-bdb6ee2d3fa9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-e9848250-61ef-4fc1-9e15-b0d847322eca req-5fbfae03-7bfb-46a9-b9db-23131ec06806 tempest-AttachVolumeTestJSON-1944458600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-c60429ab-7d7f-4eef-9838-349049ecc69e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46b7679d-cbfe-45bc-9744-9a93194634cb', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:01:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-e9848250-61ef-4fc1-9e15-b0d847322eca req-5fbfae03-7bfb-46a9-b9db-23131ec06806 tempest-AttachVolumeTestJSON-1944458600 None] attachment_update completed successfully. Aug 26 03:01:07 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 Aug 26 03:01:07 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:07 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6" returned: 0 in 0.714s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[95068d4e-dab9-4bd5-a19f-f409e31855bc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:08 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f Aug 26 03:01:08 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:08 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821" returned: 0 in 0.478s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:08 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc 1G Aug 26 03:01:08 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:08 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" returned: 0 in 0.656s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:08 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 Aug 26 03:01:08 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:08 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc 1G" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608eeb92-fe54-4126-923c-de4f1d45c821 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:08 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608eeb92-fe54-4126-923c-de4f1d45c821 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc Aug 26 03:01:08 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:09 devstack sudo[100014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6 Aug 26 03:01:09 devstack sudo[100014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-608eeb92-fe54-4126-923c-de4f1d45c821 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc" returned: 0 in 0.320s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc is being set with open permissions: ugo+rw Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:09 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc Aug 26 03:01:09 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack sudo[100014]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f.f7f5488b-92a7-4077-8650-8f05dfccf3a6" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-f7f5488b-92a7-4077-8650-8f05dfccf3a6" released by "_delete_snapshot" :: held 2.251s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" released by "delete_snapshot" :: held 2.286s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:09 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[94506]: WARNING cinder.quota [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1163379305 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1163379305, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['ef79faff-9c8b-4132-8716-ee39cd5e5c4d', '504405d2-a117-4180-a563-c4f770cb0e32', 'a4152112-4e7f-4f87-bcab-d63c22b82b4e', '4ce98a6a-4d07-4917-8e9c-68715c708786'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:09 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info Aug 26 03:01:09 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9143eab1-b48c-46b0-aca6-cb3be724751e tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 3336c524-1e16-4ef0-8bda-d8086c786432: deleted successfully Aug 26 03:01:09 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:09 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info is being set with open permissions: ugo+rw Aug 26 03:01:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:09 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info Aug 26 03:01:09 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:10 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.info" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.434s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-51a840a6-8a9e-4cef-8ea4-fc1bf804118c tempest-SnapshotMetadataTestJSON-180668651 None] Create snapshot completed successfully Aug 26 03:01:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-78e0c0c4-5daa-4953-bf57-8b3fe3907ed1 req-67c1df9e-a24d-42dd-a09f-1e5e2fbf10ab tempest-AttachVolumeTestJSON-1944458600 None] Terminate volume connection completed successfully. Aug 26 03:01:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-78e0c0c4-5daa-4953-bf57-8b3fe3907ed1 req-67c1df9e-a24d-42dd-a09f-1e5e2fbf10ab tempest-AttachVolumeTestJSON-1944458600 None] Deleting attachment 1506ebfc-2ab0-4fb4-a75d-90d9c395152a. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:01:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[14129881-0608-4cf4-be88-e8dc5152ead3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:11 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f Aug 26 03:01:11 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:11 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" returned: 0 in 0.469s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:11 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f Aug 26 03:01:11 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "cinder-ff96c590-4536-4f4a-9f25-842784bc61dc-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-ff96c590-4536-4f4a-9f25-842784bc61dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "cinder-quobyte-608eeb92-fe54-4126-923c-de4f1d45c821" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-quobyte-608eeb92-fe54-4126-923c-de4f1d45c821" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "cinder-quobyte-ff96c590-4536-4f4a-9f25-842784bc61dc" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-quobyte-ff96c590-4536-4f4a-9f25-842784bc61dc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Deleting offline snapshot ff96c590-4536-4f4a-9f25-842784bc61dc of volume 608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:11 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] snapshot_file for this snap is: volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" returned: 0 in 0.356s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9c744-35e4-41fb-b4e7-9e67f60e2db9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-5ffab8c4-2d9e-4cac-8775-42cc0b20349f" released by "delete_volume" :: held 0.922s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['73bdae93-3757-49f1-99cc-9c96fdef375a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:12 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc Aug 26 03:01:12 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:12 devstack cinder-volume[94506]: WARNING cinder.db.api [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1163379305'] Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['cef0627b-08e7-411f-b2b3-8ece76bf69ba', 'e81c2c56-e79b-41d0-8bb9-1b3279d2d23c', 'cb319995-74ae-4877-a302-bf6ef6157553', '49e70750-ce59-4cd8-a628-f3c8cd98ba43'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-257bdad1-6180-4d01-b731-8cbc4f775f0f req-f54cd699-403f-42a0-9743-7b0b55688356 tempest-AttachVolumeTestJSON-1944458600 None] Terminate volume connection completed successfully. Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-257bdad1-6180-4d01-b731-8cbc4f775f0f req-f54cd699-403f-42a0-9743-7b0b55688356 tempest-AttachVolumeTestJSON-1944458600 None] Deleting attachment 46b7679d-cbfe-45bc-9744-9a93194634cb. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:01:12 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:12 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:12 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc" returned: 0 in 0.605s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-608eeb92-fe54-4126-923c-de4f1d45c821(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ffd08a-4c6b-4c03-a2b3-934ec4def066]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:12 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-897258d0-1d02-4e79-b7f9-12b69c730041 tempest-GroupSnapshotsTest-1617530097 None] Delete group completed successfully. Aug 26 03:01:12 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 Aug 26 03:01:12 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:12 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821" returned: 0 in 0.462s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:13 devstack sudo[100092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc Aug 26 03:01:13 devstack sudo[100092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:13 devstack sudo[100092]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc" returned: 0 in 0.508s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:13 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc Aug 26 03:01:13 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:14 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821.ff96c590-4536-4f4a-9f25-842784bc61dc" returned: 0 in 0.665s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-quobyte-ff96c590-4536-4f4a-9f25-842784bc61dc" released by "_delete_snapshot" :: held 2.444s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-quobyte-608eeb92-fe54-4126-923c-de4f1d45c821" released by "delete_snapshot" :: held 2.504s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c7a867ea-7d55-429c-b6d5-f67065dab539 tempest-GroupSnapshotsTest-1617530097 None] Group tempest-GroupSnapshotsTest-Group-355554558: creating Aug 26 03:01:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c7a867ea-7d55-429c-b6d5-f67065dab539 tempest-GroupSnapshotsTest-1617530097 None] Group tempest-GroupSnapshotsTest-Group-355554558: created successfully Aug 26 03:01:14 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Created reservations ['65387e8d-8043-402d-858e-c504d358fb1d', 'a4c3f36f-2e48-474d-b038-7217a974344d', 'a16c7030-a9a8-4ff9-8f79-d6ad8db951da', '3b3bac79-f7a7-4d3d-90c2-fdf8eaa55f0d'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c7a867ea-7d55-429c-b6d5-f67065dab539 tempest-GroupSnapshotsTest-1617530097 None] Create group completed successfully. Aug 26 03:01:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Delete snapshot completed successfully. Aug 26 03:01:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83aa4471-361b-481e-95ee-467558742da0 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-ff96c590-4536-4f4a-9f25-842784bc61dc-delete_snapshot" released by "delete_snapshot" :: held 2.751s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Flow 'volume_create_manager' (c54af363-97c1-4f58-9c52-f027aac7c691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e035847b-922b-4537-96ae-9f9f4ec5785d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e035847b-922b-4537-96ae-9f9f4ec5785d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-147524900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e14bea-052e-4be3-85b3-b666ac3c6ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b012baec8ed40b1bc7e22fdb5898506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:15Z,use_quota=True,user_id='d731c5690d5b4abfbef4e19cd02ce4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a54d6d-437f-40fb-a8cc-66c1d6e9ffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a54d6d-437f-40fb-a8cc-66c1d6e9ffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e903f5-7abc-448f-ba5a-f5ddcea71899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33e903f5-7abc-448f-ba5a-f5ddcea71899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e14bea-052e-4be3-85b3-b666ac3c6ce7', 'volume_name': 'volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bebc0e3-3fce-4851-99f6-0eb49686835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bebc0e3-3fce-4851-99f6-0eb49686835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a885c59-f66c-44b6-99b7-408160822e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:15 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Volume 20e14bea-052e-4be3-85b3-b666ac3c6ce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7', 'volume_size': 1} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-147524900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e14bea-052e-4be3-85b3-b666ac3c6ce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b012baec8ed40b1bc7e22fdb5898506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:15Z,use_quota=True,user_id='d731c5690d5b4abfbef4e19cd02ce4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Creating volume 20e14bea-052e-4be3-85b3-b666ac3c6ce7 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:15 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:15 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 1073741824 Aug 26 03:01:15 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "cinder-608eeb92-fe54-4126-923c-de4f1d45c821-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-608eeb92-fe54-4126-923c-de4f1d45c821-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "cinder-quobyte-608eeb92-fe54-4126-923c-de4f1d45c821" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-quobyte-608eeb92-fe54-4126-923c-de4f1d45c821" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0d78dc-60a6-424d-aa47-22dd729caa05]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:15 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 Aug 26 03:01:15 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:15 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 1073741824" returned: 0 in 0.837s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:16 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 Aug 26 03:01:16 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:16 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821" returned: 0 in 0.635s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:16 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821 Aug 26 03:01:16 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (3fa53d7a-6df9-4116-9066-a40c557969aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ff9d19-e8a3-4906-8891-b1cc3a1b652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ff9d19-e8a3-4906-8891-b1cc3a1b652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1648386576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0021ef2e-813a-490b-a6b2-b7e78e0eba9d,host='devstack@QuobyteHD#QuobyteHD',id=dc9dadd8-16e4-40cf-bef4-6e6780aa5ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:16Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(572a5bb5-b7dc-4892-b74f-98c1fe2d3e67),volume_type_id=572a5bb5-b7dc-4892-b74f-98c1fe2d3e67)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3bbb7d-03f6-46ae-ba40-13e4f8721841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3bbb7d-03f6-46ae-ba40-13e4f8721841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3de8c4-db2b-4754-b645-9f039706974a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c3de8c4-db2b-4754-b645-9f039706974a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc9dadd8-16e4-40cf-bef4-6e6780aa5ede', 'volume_name': 'volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df321524-e78c-4ec6-84d0-0e3e958c5875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df321524-e78c-4ec6-84d0-0e3e958c5875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbc0714-97c3-4084-8add-bff8532f6fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Volume dc9dadd8-16e4-40cf-bef4-6e6780aa5ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede', 'volume_size': 1} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:16 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7" returned: 0 in 0.642s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0021ef2e-813a-490b-a6b2-b7e78e0eba9d,created_at=2026-08-26T01:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1648386576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0021ef2e-813a-490b-a6b2-b7e78e0eba9d,host='devstack@QuobyteHD#QuobyteHD',id=dc9dadd8-16e4-40cf-bef4-6e6780aa5ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:16Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(572a5bb5-b7dc-4892-b74f-98c1fe2d3e67),volume_type_id=572a5bb5-b7dc-4892-b74f-98c1fe2d3e67)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Creating volume dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:16 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:16 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a885c59-f66c-44b6-99b7-408160822e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede 1073741824 Aug 26 03:01:16 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba31ccd-137f-4e5b-bddb-7c661ce138f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-608eeb92-fe54-4126-923c-de4f1d45c821" returned: 0 in 0.619s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-quobyte-608eeb92-fe54-4126-923c-de4f1d45c821" released by "delete_volume" :: held 1.352s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Volume volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 (20e14bea-052e-4be3-85b3-b666ac3c6ce7): created successfully Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ba31ccd-137f-4e5b-bddb-7c661ce138f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Flow 'volume_create_manager' (c54af363-97c1-4f58-9c52-f027aac7c691) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a9b26173-524d-4898-8eb3-8ef66cb028db tempest-ServerActionsTestOtherA-319111576 None] Created volume successfully. Aug 26 03:01:16 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Created reservations ['f55914d7-c124-40f2-af4a-6f3a570b0063', 'bc877a6e-5761-45ab-b8e1-a56af292c969', 'b3c07a93-ce39-4ce9-86d1-209106291654', 'cd972e60-9702-423e-8b9f-ef81d6692622'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:17 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:17 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:17 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.379s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Deleted volume successfully. Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-78e24562-5163-49c5-a545-875a86184028 tempest-SnapshotMetadataTestJSON-180668651 None] Lock "cinder-608eeb92-fe54-4126-923c-de4f1d45c821-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:17 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede 1073741824" returned: 0 in 0.749s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:17 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede Aug 26 03:01:17 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:18 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" returned: 0 in 0.450s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bbc0714-97c3-4084-8add-bff8532f6fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1178950f-d4d6-4601-bab9-9d9513980b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:18 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Volume volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede (dc9dadd8-16e4-40cf-bef4-6e6780aa5ede): created successfully Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1178950f-d4d6-4601-bab9-9d9513980b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (3fa53d7a-6df9-4116-9066-a40c557969aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:18 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3fee62e6-28ce-4159-ada6-b1d4286e5d27 tempest-GroupSnapshotsTest-1617530097 None] Created volume successfully. Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "cinder-c60429ab-7d7f-4eef-9838-349049ecc69e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-c60429ab-7d7f-4eef-9838-349049ecc69e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "cinder-quobyte-c60429ab-7d7f-4eef-9838-349049ecc69e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-quobyte-c60429ab-7d7f-4eef-9838-349049ecc69e" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb92bd98-ae39-4f7e-8732-a666ef51c0b9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:19 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e Aug 26 03:01:19 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (69765aa6-b971-462a-8862-a7dd8788399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e273b82e-9dfb-48df-8e80-e021a71798f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e273b82e-9dfb-48df-8e80-e021a71798f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1082120539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0021ef2e-813a-490b-a6b2-b7e78e0eba9d,host='devstack@QuobyteHD#QuobyteHD',id=fe2cf7e0-506c-4866-bbe6-fd90aba55b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:20Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(572a5bb5-b7dc-4892-b74f-98c1fe2d3e67),volume_type_id=572a5bb5-b7dc-4892-b74f-98c1fe2d3e67)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d351f0de-4820-4717-b717-98fbaa40ee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d351f0de-4820-4717-b717-98fbaa40ee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444669a4-dc66-4021-9a21-30cc573c0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444669a4-dc66-4021-9a21-30cc573c0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2cf7e0-506c-4866-bbe6-fd90aba55b7e', 'volume_name': 'volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65059ace-4d51-433a-8e2f-39208d536b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65059ace-4d51-433a-8e2f-39208d536b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec92f53-07d5-4560-85f4-a014b98983a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Volume fe2cf7e0-506c-4866-bbe6-fd90aba55b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e', 'volume_size': 1} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0021ef2e-813a-490b-a6b2-b7e78e0eba9d,created_at=2026-08-26T01:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1082120539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0021ef2e-813a-490b-a6b2-b7e78e0eba9d,host='devstack@QuobyteHD#QuobyteHD',id=fe2cf7e0-506c-4866-bbe6-fd90aba55b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:20Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(572a5bb5-b7dc-4892-b74f-98c1fe2d3e67),volume_type_id=572a5bb5-b7dc-4892-b74f-98c1fe2d3e67)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Creating volume fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:20 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e 1073741824 Aug 26 03:01:20 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:20 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:20 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:20 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e" returned: 0 in 0.692s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:20 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e Aug 26 03:01:20 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:20 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.421s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 8 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:01:20 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c60429ab-7d7f-4eef-9838-349049ecc69e" returned: 0 in 0.428s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-quobyte-c60429ab-7d7f-4eef-9838-349049ecc69e" released by "delete_volume" :: held 1.177s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Created reservations ['71365ad4-4903-4dd2-9b1b-c69c855c50d1', '006d1a35-f08a-4cd5-a529-f2f9f8be7dcb', '93d690a8-eb63-4203-8724-4bada4ff73c9', '46d86673-cb01-4420-a22a-2f5e0257524c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:20 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e 1073741824" returned: 0 in 0.765s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:20 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e Aug 26 03:01:20 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:20 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:20 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:21 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" returned: 0 in 0.416s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eec92f53-07d5-4560-85f4-a014b98983a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b081ca-f481-42f4-a633-caa2682eda6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Volume volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e (fe2cf7e0-506c-4866-bbe6-fd90aba55b7e): created successfully Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9b081ca-f481-42f4-a633-caa2682eda6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (69765aa6-b971-462a-8862-a7dd8788399b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cc792fd9-4250-4ab9-909f-4d07813c2826 tempest-GroupSnapshotsTest-1617530097 None] Created volume successfully. Aug 26 03:01:21 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.448s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Deleted volume successfully. Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-94bed9ce-1a7c-4e67-b855-b3e35d3251f7 tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-c60429ab-7d7f-4eef-9838-349049ecc69e-delete_volume" released by "delete_volume" :: held 1.972s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "cinder-aaefe246-84e5-4f87-bd00-08ab2f831fe0-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-aaefe246-84e5-4f87-bd00-08ab2f831fe0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "cinder-quobyte-aaefe246-84e5-4f87-bd00-08ab2f831fe0" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-quobyte-aaefe246-84e5-4f87-bd00-08ab2f831fe0" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e40049-0a4f-40a3-a59d-a1b760f36eac]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:22 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 Aug 26 03:01:22 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:22 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0" returned: 0 in 0.510s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:22 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0 Aug 26 03:01:22 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:22 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-aaefe246-84e5-4f87-bd00-08ab2f831fe0" returned: 0 in 0.327s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-44025bc8-a7b8-4406-8b83-99d5506863b7 tempest-GroupSnapshotsTest-1617530097 None] Update group completed successfully. Aug 26 03:01:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-quobyte-aaefe246-84e5-4f87-bd00-08ab2f831fe0" released by "delete_volume" :: held 0.889s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:22 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Created reservations ['f7f0d224-3be9-41ab-86c8-a5fbe038ba62', '5f1a3696-0850-44b1-903d-5346d10ad723', 'ff6bdad7-3bde-4796-a8b5-f6b06fc059b1', 'c8717445-0934-4347-8990-8a3ec11365b8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:23 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:23 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "cinder-7be5b9aa-f557-40e9-95aa-cdf74b22c214-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-7be5b9aa-f557-40e9-95aa-cdf74b22c214-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "cinder-quobyte-7be5b9aa-f557-40e9-95aa-cdf74b22c214" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-quobyte-7be5b9aa-f557-40e9-95aa-cdf74b22c214" acquired by "delete_volume" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3973d94d-3361-4c7b-a640-bd828e2ea6fa]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:23 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.546s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Deleted volume successfully. Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a8dbac0d-5d80-4696-8e48-74ade38c152d tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-aaefe246-84e5-4f87-bd00-08ab2f831fe0-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:23 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 Aug 26 03:01:23 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Flow 'volume_create_manager' (8e788a5f-977f-417d-af50-0040f0c941f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0764f6f6-03e6-4ba1-b1b0-568e6ff1436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0764f6f6-03e6-4ba1-b1b0-568e6ff1436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-451974915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e526799bd3c481093bb0ebe1bcc3116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:24Z,use_quota=True,user_id='fe69e20740db4a3abe3bdb0c2f73e7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09248435-8817-49b4-9a8d-eb7ac95f2230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09248435-8817-49b4-9a8d-eb7ac95f2230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55bc949-f1af-4d14-83a3-6abd201bb0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f55bc949-f1af-4d14-83a3-6abd201bb0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f', 'volume_name': 'volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff6cc28-3558-4371-b70a-65ea2064d0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff6cc28-3558-4371-b70a-65ea2064d0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d19960-93ab-4684-8f38-40cdb4153265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:23 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Volume 14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f', 'volume_size': 1} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-451974915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e526799bd3c481093bb0ebe1bcc3116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:24Z,use_quota=True,user_id='fe69e20740db4a3abe3bdb0c2f73e7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Creating volume 14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:23 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:23 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f 1073741824 Aug 26 03:01:23 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-03afb3c2-720a-4c5b-a025-b08918bf40d2 tempest-GroupSnapshotsTest-1617530097 None] Update group completed successfully. Aug 26 03:01:24 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214" returned: 0 in 0.601s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:24 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214 Aug 26 03:01:24 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7be5b9aa-f557-40e9-95aa-cdf74b22c214" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-quobyte-7be5b9aa-f557-40e9-95aa-cdf74b22c214" released by "delete_volume" :: held 0.977s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Created reservations ['00dce90d-7de7-47ee-8454-1bcdedf5dd17', 'c023c5ea-7882-4196-a2f7-3af9a114889e', 'fddccb54-848e-4530-a15e-481963ed1b3b', 'f397736b-09a7-4362-ab6d-bb33a22c6c5d'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:24 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f 1073741824" returned: 0 in 0.599s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:24 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f Aug 26 03:01:24 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:24 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:24 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:24 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f" returned: 0 in 0.271s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d19960-93ab-4684-8f38-40cdb4153265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a291c7fd-ae4d-4fe0-86fd-52b8bd23b703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:24 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Volume volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f (14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f): created successfully Aug 26 03:01:24 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a291c7fd-ae4d-4fe0-86fd-52b8bd23b703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Flow 'volume_create_manager' (8e788a5f-977f-417d-af50-0040f0c941f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.289s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:24 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Deleted volume successfully. Aug 26 03:01:24 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8e76831f-3128-4ed4-9274-8c1c720b27d9 tempest-AbsoluteLimitsTests-1528970349 None] Created volume successfully. Aug 26 03:01:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-465efdc1-f3a3-4732-b48a-5e0a444686af tempest-AttachVolumeTestJSON-1944458600 None] Lock "cinder-7be5b9aa-f557-40e9-95aa-cdf74b22c214-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e6697477-cdff-4a1c-93df-726d549349ae tempest-GroupSnapshotsTest-1617530097 None] Update group completed successfully. Aug 26 03:01:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Acquiring lock "cinder-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Lock "cinder-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Acquiring lock "cinder-quobyte-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Lock "cinder-quobyte-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a812d86-ffac-4085-9543-ec99d3b36c10]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:26 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f Aug 26 03:01:26 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5c5051d7-528c-4035-8ed5-e0ea2690faf2 tempest-GroupSnapshotsTest-1617530097 None] Update group completed successfully. Aug 26 03:01:26 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f" returned: 0 in 0.667s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:26 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f Aug 26 03:01:26 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:27 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f" returned: 0 in 0.372s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Lock "cinder-quobyte-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f" released by "delete_volume" :: held 1.164s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Created reservations ['20904c63-a93d-4200-a1a8-2bca5a31d2cd', '1a2d6052-02a4-45ba-89cf-45ade5222d52', '30596d6c-eca6-4165-aa4d-545c6e3cfd58', '8527f2bd-469f-4ac7-b2fc-d507a6e6ca1e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:27 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:27 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:27 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Deleted volume successfully. Aug 26 03:01:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7364b448-2551-4c2a-b41b-2ed462b71141 tempest-AbsoluteLimitsTests-1528970349 None] Lock "cinder-14526a2f-ac4f-4d07-8c7e-6a2d1c0cdb6f-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] GroupSnapshot 6c49bbd2-c710-4a8f-b4bb-5a1daf27e21c: creating. Aug 26 03:01:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Group snapshot 6c49bbd2-c710-4a8f-b4bb-5a1daf27e21c: creating. {{(pid=94506) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:01:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Creating offline snapshot 3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 of volume dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c3a24-a48f-4e8f-b304-328284d9225a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:28 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede Aug 26 03:01:28 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" returned: 0 in 0.627s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 1G Aug 26 03:01:29 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:29 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 1G" returned: 0 in 0.656s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:29 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 Aug 26 03:01:29 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:30 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" returned: 0 in 0.465s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:30 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:30 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 Aug 26 03:01:30 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:30 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" returned: 0 in 0.373s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=136,cinder:INSERT=33,cinder:UPDATE=172,cinder:DELETE=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=166,cinder:INSERT=44,cinder:UPDATE=167,cinder:DELETE=15 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:30 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info Aug 26 03:01:30 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:30 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info" returned: 0 in 0.390s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:30 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:30 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info Aug 26 03:01:30 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:31 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.info" returned: 0 in 0.499s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.170s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Creating offline snapshot db8588b9-19f0-4f94-b6fa-aa5c1ca1528a of volume fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1e42a5-58a0-4de2-aa3f-0ecf3d785df6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:31 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e Aug 26 03:01:31 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:31 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" returned: 0 in 0.420s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:31 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a 1G Aug 26 03:01:31 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:32 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a 1G" returned: 0 in 0.642s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:32 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a Aug 26 03:01:32 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:33 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" returned: 0 in 0.524s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:33 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:33 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a Aug 26 03:01:33 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:33 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" returned: 0 in 0.607s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:33 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info Aug 26 03:01:33 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:34 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info" returned: 0 in 0.609s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:34 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:34 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info Aug 26 03:01:34 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:34 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.info" returned: 0 in 0.482s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.440s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-987697c6-9a2a-4e41-b386-323848511682 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 6c49bbd2-c710-4a8f-b4bb-5a1daf27e21c: created successfully Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Flow 'volume_create_manager' (ee5d82ad-1e55-41bf-a1c1-5cfefd0806e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64698296-8d77-4926-b282-982ffc9f755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64698296-8d77-4926-b282-982ffc9f755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1811142231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd0f7ec-0985-4511-8d7a-3a8f8bda917d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c7671e105423daa2cff29ce5a0e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:36Z,use_quota=True,user_id='049e891aa7134f2ba1952ec48256f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd868212-5416-4100-a60f-9194016310f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd868212-5416-4100-a60f-9194016310f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c1da44-5baa-4f27-8df2-be8c128f4581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85c1da44-5baa-4f27-8df2-be8c128f4581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd0f7ec-0985-4511-8d7a-3a8f8bda917d', 'volume_name': 'volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49898010-7989-4bbb-b4fc-905655949c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49898010-7989-4bbb-b4fc-905655949c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72784c5-0af5-4236-bc96-b3949b8bb1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Volume 3bd0f7ec-0985-4511-8d7a-3a8f8bda917d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d', 'volume_size': 1} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1811142231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd0f7ec-0985-4511-8d7a-3a8f8bda917d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c7671e105423daa2cff29ce5a0e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:36Z,use_quota=True,user_id='049e891aa7134f2ba1952ec48256f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Creating volume 3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:35 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:35 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d 1073741824 Aug 26 03:01:35 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 6c49bbd2-c710-4a8f-b4bb-5a1daf27e21c: deleting Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 6c49bbd2-c710-4a8f-b4bb-5a1daf27e21c: deleting {{(pid=94506) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Deleting offline snapshot 3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 of volume dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] snapshot_file for this snap is: volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba299a1-5db3-4906-b56a-9ddc42287f3f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:36 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 Aug 26 03:01:36 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:36 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d 1073741824" returned: 0 in 0.942s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:36 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d Aug 26 03:01:36 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:37 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" returned: 0 in 0.616s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8e888a-07a5-4ee9-a665-a155c409b5c1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:37 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" returned: 0 in 0.380s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72784c5-0af5-4236-bc96-b3949b8bb1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f00cfc5-7a75-41bc-8690-48baadb7db33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Volume volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d (3bd0f7ec-0985-4511-8d7a-3a8f8bda917d): created successfully Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f00cfc5-7a75-41bc-8690-48baadb7db33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Flow 'volume_create_manager' (ee5d82ad-1e55-41bf-a1c1-5cfefd0806e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-16b70629-68b3-4621-905c-87ae52f181d7 tempest-VolumesDeleteCascade-681479385 None] Created volume successfully. Aug 26 03:01:37 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede Aug 26 03:01:37 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:37 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" returned: 0 in 0.468s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:37 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 Aug 26 03:01:37 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:38 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:38 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6 Aug 26 03:01:38 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Creating offline snapshot c980f29c-db6c-4b26-bb0f-b0a7a8c85452 of volume 3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac266c9-3105-4f48-853d-978eaab9b76b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:38 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede.3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:38 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d Aug 26 03:01:38 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-3f175ec2-3464-4b0e-bbfa-f1a43d8368f6" released by "_delete_snapshot" :: held 2.060s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" released by "delete_snapshot" :: held 2.103s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Deleting offline snapshot db8588b9-19f0-4f94-b6fa-aa5c1ca1528a of volume fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] snapshot_file for this snap is: volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f68e1-6dd0-4ae6-b993-4aa5675f0d40]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:38 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a Aug 26 03:01:38 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:38 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" returned: 0 in 0.551s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:38 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 1G Aug 26 03:01:38 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:39 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" returned: 0 in 0.535s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[957d025d-fa8a-49a8-aded-9338a495d672]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:39 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e Aug 26 03:01:39 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:39 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 1G" returned: 0 in 0.618s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:39 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:39 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:39 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" returned: 0 in 0.610s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:39 devstack sudo[100444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a Aug 26 03:01:39 devstack sudo[100444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:39 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.471s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:39 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 is being set with open permissions: ugo+rw Aug 26 03:01:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:39 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:39 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:40 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.441s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:40 devstack sudo[100444]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" returned: 0 in 0.609s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:40 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a Aug 26 03:01:40 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:40 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info Aug 26 03:01:40 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:40 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e.db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" returned: 0 in 0.418s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:40 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-db8588b9-19f0-4f94-b6fa-aa5c1ca1528a" released by "_delete_snapshot" :: held 2.329s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info" returned: 0 in 0.430s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:40 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info is being set with open permissions: ugo+rw Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" released by "delete_snapshot" :: held 2.392s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:40 devstack sudo[100459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info Aug 26 03:01:40 devstack sudo[100459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:41 devstack cinder-volume[94506]: WARNING cinder.quota [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-647570129 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-647570129, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:41 devstack cinder-volume[94506]: WARNING cinder.quota [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-647570129 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-647570129, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:41 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['7bf3d599-fcf9-407b-b25b-357d7bd86eb8', '3532717a-37f8-4283-ad72-db40c18d228d', 'f8fed353-802b-410f-8d2f-590e898ce8ff', '9e0f8fba-dcd1-4a5d-b26c-61d3f5ade9ff'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:41 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['c6354055-90b2-4775-a5ab-6f1e3eeaab2e', '4af06126-ad95-4b8b-81bf-fc397722e02a', 'f1e5bacf-63b6-466c-bb9b-13676dea571b', '85cf290d-7656-40ea-aab1-221d95615f0b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:41 devstack sudo[100459]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.info" returned: 0 in 0.464s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.171s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2db52301-2a23-4f52-8e9f-7e32935cb1d8 tempest-VolumesDeleteCascade-681479385 None] Create snapshot completed successfully Aug 26 03:01:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-279f968e-959e-4673-9cf6-fe8a86b66748 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 6c49bbd2-c710-4a8f-b4bb-5a1daf27e21c: deleted successfully Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Creating offline snapshot 08c054e5-2257-4bb4-84a4-994185d511cc of volume 3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8e8332-e6d2-4327-acf6-445734f7b137]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:42 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:43 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a827b697-3536-4a00-926f-af3ac5226d4a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:43 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede Aug 26 03:01:43 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:43 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.503s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:43 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc 1G Aug 26 03:01:43 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:43 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" returned: 0 in 0.541s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:43 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede Aug 26 03:01:43 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:43 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc 1G" returned: 0 in 0.593s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:43 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" returned: 0 in 0.385s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:43 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc Aug 26 03:01:43 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-dc9dadd8-16e4-40cf-bef4-6e6780aa5ede" released by "delete_volume" :: held 1.042s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[152995a1-15d0-483a-b4a7-8d0738fd4a57]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:44 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e Aug 26 03:01:44 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:44 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc" returned: 0 in 0.385s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:44 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc is being set with open permissions: ugo+rw Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:44 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc Aug 26 03:01:44 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:44 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:44 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e Aug 26 03:01:44 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:44 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cd5fae12-5dae-4310-9f4e-2c4eb0e25343 tempest-VolumesDeleteCascade-681479385 None] Create snapshot completed successfully Aug 26 03:01:44 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" returned: 0 in 0.281s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-fe2cf7e0-506c-4866-bbe6-fd90aba55b7e" released by "delete_volume" :: held 0.784s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['bc8b2133-22ab-4984-90d5-bebcf0f4929e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:44 devstack cinder-volume[94506]: WARNING cinder.quota [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-647570129 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-647570129, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['777fb773-3dc7-45ce-a981-ecdf27a83400', '7151bfc9-8205-4199-8e01-abb714579d4d', 'b038ca17-1d35-4976-9b9d-aadb857fed7d', '97530f63-9f5b-4012-8692-141fdae6e50d'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Performing cascade delete. {{(pid=94506) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-08c054e5-2257-4bb4-84a4-994185d511cc-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-08c054e5-2257-4bb4-84a4-994185d511cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-08c054e5-2257-4bb4-84a4-994185d511cc" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-08c054e5-2257-4bb4-84a4-994185d511cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Deleting offline snapshot 08c054e5-2257-4bb4-84a4-994185d511cc of volume 3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] snapshot_file for this snap is: volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2294fe87-90c4-4f2d-beed-24e003542e86]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['056abfae-a1d9-4a14-b15a-265a76a21748', '9bf99e97-377c-449e-b5b0-bc08ac12c20f', '19b61020-4f41-41ef-b1d5-c9d7594ef5ee', '6a6e58d9-2acc-47d8-bd1b-90609b3006a2'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:45 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc Aug 26 03:01:45 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:45 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:45 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:45 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d58fba11-b0fe-45a4-94a0-c78bc6c95816 tempest-GroupSnapshotsTest-1617530097 None] Delete group completed successfully. Aug 26 03:01:45 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc" returned: 0 in 0.649s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9191fa8a-107f-4e39-98ee-ace7c2a5e951]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:46 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:46 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:46 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.399s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:46 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc Aug 26 03:01:46 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:46 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc" returned: 0 in 0.482s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:46 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc Aug 26 03:01:46 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-505be7aa-616b-45f1-b435-baadb13be1f3 tempest-GroupSnapshotsTest-1617530097 None] Group tempest-GroupSnapshotsTest-Group-747557753: creating Aug 26 03:01:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-505be7aa-616b-45f1-b435-baadb13be1f3 tempest-GroupSnapshotsTest-1617530097 None] Group tempest-GroupSnapshotsTest-Group-747557753: created successfully Aug 26 03:01:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-505be7aa-616b-45f1-b435-baadb13be1f3 tempest-GroupSnapshotsTest-1617530097 None] Create group completed successfully. Aug 26 03:01:47 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.08c054e5-2257-4bb4-84a4-994185d511cc" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-08c054e5-2257-4bb4-84a4-994185d511cc" released by "_delete_snapshot" :: held 2.097s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" released by "delete_snapshot" :: held 2.132s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Created reservations ['4358b651-f173-480b-9cbc-cbeac46dc916', '6f9ff492-53df-4d2c-b292-d235d7ad4da5', 'e57a825a-0a13-42d2-9aa2-f8d9b1a978da', '60e63d26-8a28-4188-a356-736f9a5c055b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Delete snapshot completed successfully. Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-08c054e5-2257-4bb4-84a4-994185d511cc-delete_snapshot" released by "delete_snapshot" :: held 2.343s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-c980f29c-db6c-4b26-bb0f-b0a7a8c85452-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-c980f29c-db6c-4b26-bb0f-b0a7a8c85452-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-c980f29c-db6c-4b26-bb0f-b0a7a8c85452" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-c980f29c-db6c-4b26-bb0f-b0a7a8c85452" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Deleting offline snapshot c980f29c-db6c-4b26-bb0f-b0a7a8c85452 of volume 3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] snapshot_file for this snap is: volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a273f342-33ae-4382-878c-a5a926191879]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:47 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:47 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:47 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[471c6244-0be4-4595-b755-8342d3763f27]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:48 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d Aug 26 03:01:48 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:48 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" returned: 0 in 0.519s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:48 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:48 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:49 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.659s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:49 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452 Aug 26 03:01:49 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (1632a27a-79b5-4cc2-a89f-1e370aca1eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d78fa8-71e3-40b4-a12f-0f2a0894f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d78fa8-71e3-40b4-a12f-0f2a0894f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274835087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1a1e14b-4f9f-4334-8c6f-9a5bd7f74d9a,host='devstack@QuobyteHD#QuobyteHD',id=630716ef-8994-4014-8803-db7fab6b81e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:49Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0d993e-621e-434b-8a39-aeed693a2895),volume_type_id=9b0d993e-621e-434b-8a39-aeed693a2895)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ba05f-4568-4820-bbe4-fc372c2f529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (817ba05f-4568-4820-bbe4-fc372c2f529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b94b5f-0d2e-4680-8269-e7f263744a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b94b5f-0d2e-4680-8269-e7f263744a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630716ef-8994-4014-8803-db7fab6b81e5', 'volume_name': 'volume-630716ef-8994-4014-8803-db7fab6b81e5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362a3bbc-79bd-46ea-91d1-3eede6909f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362a3bbc-79bd-46ea-91d1-3eede6909f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d302d848-d2aa-436a-a588-004551d16bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:49 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Volume 630716ef-8994-4014-8803-db7fab6b81e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630716ef-8994-4014-8803-db7fab6b81e5', 'volume_size': 1} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e1a1e14b-4f9f-4334-8c6f-9a5bd7f74d9a,created_at=2026-08-26T01:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1274835087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e1a1e14b-4f9f-4334-8c6f-9a5bd7f74d9a,host='devstack@QuobyteHD#QuobyteHD',id=630716ef-8994-4014-8803-db7fab6b81e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037f53bb09a84187a55ba21fbfb640dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:49Z,use_quota=True,user_id='17524773c66b4c218d6369e3d0175257',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9b0d993e-621e-434b-8a39-aeed693a2895),volume_type_id=9b0d993e-621e-434b-8a39-aeed693a2895)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Creating volume 630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:49 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:49 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 1073741824 Aug 26 03:01:49 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:49 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d.c980f29c-db6c-4b26-bb0f-b0a7a8c85452" returned: 0 in 0.490s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-c980f29c-db6c-4b26-bb0f-b0a7a8c85452" released by "_delete_snapshot" :: held 2.197s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" released by "delete_snapshot" :: held 2.235s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Created reservations ['5a0516c7-2085-4622-9c51-a51f0ad943d2', 'a3862b74-2c60-4753-b4c4-f5470a965a55', 'f34e624d-215a-455f-8372-9c2413695194', 'b138ba02-5eed-465a-b555-119b89b23388'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Delete snapshot completed successfully. Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-c980f29c-db6c-4b26-bb0f-b0a7a8c85452-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Snapshots deleted, issuing volume delete {{(pid=94506) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c929fa9e-7b9e-4419-87a4-e44a2c4af0e3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:50 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 1073741824" returned: 0 in 0.687s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:50 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 Aug 26 03:01:50 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:50 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d Aug 26 03:01:50 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:50 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5" returned: 0 in 0.453s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:50 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" returned: 0 in 0.618s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:50 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d Aug 26 03:01:50 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d302d848-d2aa-436a-a588-004551d16bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630716ef-8994-4014-8803-db7fab6b81e5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52908f1c-9221-44ad-949b-76663623ade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:50 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Volume volume-630716ef-8994-4014-8803-db7fab6b81e5 (630716ef-8994-4014-8803-db7fab6b81e5): created successfully Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52908f1c-9221-44ad-949b-76663623ade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Flow 'volume_create_manager' (1632a27a-79b5-4cc2-a89f-1e370aca1eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ff7e2c26-a9b1-4c44-b86e-b36b291058f7 tempest-GroupSnapshotsTest-1617530097 None] Created volume successfully. Aug 26 03:01:50 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d" released by "delete_volume" :: held 0.981s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:50 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Created reservations ['4343a733-6b72-46f9-ba80-3ac92e9829dd', '69f5f17d-9cf1-4f3d-99ae-1ed6955d1506', '599339ec-d04a-4e67-88bc-2719f6fffa7c', '98c52ea4-1198-49f7-b09d-583ef04cc38c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:51 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:01:51 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:51 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:01:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Deleted volume successfully. Aug 26 03:01:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4446686e-4601-4219-aa14-cd9140346f9d tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-3bd0f7ec-0985-4511-8d7a-3a8f8bda917d-delete_volume" released by "delete_volume" :: held 6.417s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] GroupSnapshot 36684a07-6fae-4fbd-9fb9-27a7e35d9888: creating. Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Group snapshot 36684a07-6fae-4fbd-9fb9-27a7e35d9888: creating. {{(pid=94506) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Creating offline snapshot bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b of volume 630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4d318-cc24-4176-bb13-1ffaa456cb70]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:52 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 Aug 26 03:01:52 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:52 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5" returned: 0 in 0.583s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:52 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b 1G Aug 26 03:01:52 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Flow 'volume_create_manager' (ef9f27a0-aa15-49c1-949b-6a9fd139bb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7467cb-5ae3-423e-a5ad-db577d7d6d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e7467cb-5ae3-423e-a5ad-db577d7d6d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-258566402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e2719e-f029-47f5-a8fa-31a43045f4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c7671e105423daa2cff29ce5a0e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:53Z,use_quota=True,user_id='049e891aa7134f2ba1952ec48256f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a0866b-adb3-44ed-8d23-9e1e1ce32129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a0866b-adb3-44ed-8d23-9e1e1ce32129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca98f41-b04a-4656-8ab3-adaa9d829d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca98f41-b04a-4656-8ab3-adaa9d829d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e2719e-f029-47f5-a8fa-31a43045f4da', 'volume_name': 'volume-97e2719e-f029-47f5-a8fa-31a43045f4da', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088df0d5-2ca1-4231-8ab0-ab425cf70ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088df0d5-2ca1-4231-8ab0-ab425cf70ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc1ab59-803e-428d-959a-d39b73c6a14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:52 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Volume 97e2719e-f029-47f5-a8fa-31a43045f4da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e2719e-f029-47f5-a8fa-31a43045f4da', 'volume_size': 1} Aug 26 03:01:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:53 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b 1G" returned: 0 in 0.564s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630716ef-8994-4014-8803-db7fab6b81e5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:53 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630716ef-8994-4014-8803-db7fab6b81e5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b Aug 26 03:01:53 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:53 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630716ef-8994-4014-8803-db7fab6b81e5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" returned: 0 in 0.449s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:53 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:53 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b Aug 26 03:01:53 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:54 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:54 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info Aug 26 03:01:54 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:54 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info" returned: 0 in 0.353s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:54 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:54 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info Aug 26 03:01:54 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:54 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.info" returned: 0 in 0.297s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.790s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:01:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-258566402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e2719e-f029-47f5-a8fa-31a43045f4da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c7671e105423daa2cff29ce5a0e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:01:53Z,use_quota=True,user_id='049e891aa7134f2ba1952ec48256f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Creating volume 97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:01:54 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:01:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:54 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da 1073741824 Aug 26 03:01:54 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d4ba4c0c-097a-4ad5-bd6e-2abc4bc7be6f tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 36684a07-6fae-4fbd-9fb9-27a7e35d9888: created successfully Aug 26 03:01:55 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da 1073741824" returned: 0 in 0.621s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:55 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da Aug 26 03:01:55 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 36684a07-6fae-4fbd-9fb9-27a7e35d9888: deleting Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 36684a07-6fae-4fbd-9fb9-27a7e35d9888: deleting {{(pid=94506) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-630716ef-8994-4014-8803-db7fab6b81e5" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-630716ef-8994-4014-8803-db7fab6b81e5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Deleting offline snapshot bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b of volume 630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] snapshot_file for this snap is: volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee34d853-d08d-467c-8122-1177a357a110]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:56 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da" returned: 0 in 0.500s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc1ab59-803e-428d-959a-d39b73c6a14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e2719e-f029-47f5-a8fa-31a43045f4da', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e2594-f971-43d8-a877-ced75e90c1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:01:56 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Volume volume-97e2719e-f029-47f5-a8fa-31a43045f4da (97e2719e-f029-47f5-a8fa-31a43045f4da): created successfully Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b32e2594-f971-43d8-a877-ced75e90c1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Flow 'volume_create_manager' (ef9f27a0-aa15-49c1-949b-6a9fd139bb2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:01:56 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b Aug 26 03:01:56 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-73cc5363-691f-4aa3-ac20-8fcff995e65e tempest-VolumesDeleteCascade-681479385 None] Created volume successfully. Aug 26 03:01:56 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" returned: 0 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-630716ef-8994-4014-8803-db7fab6b81e5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e0db2a-ccac-46c7-8d90-3455dbfafd36]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-dd0105e8-dd78-4d55-a97b-07ce62e98f8f req-e40ddcd1-7564-4a58-bfab-d71439b64b67 tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-dd0105e8-dd78-4d55-a97b-07ce62e98f8f req-e40ddcd1-7564-4a58-bfab-d71439b64b67 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-dd0105e8-dd78-4d55-a97b-07ce62e98f8f req-e40ddcd1-7564-4a58-bfab-d71439b64b67 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-dd0105e8-dd78-4d55-a97b-07ce62e98f8f req-e40ddcd1-7564-4a58-bfab-d71439b64b67 tempest-ServerActionsTestOtherA-319111576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bd3e974-8d49-4ff9-935e-c97628d4cf0b', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:01:56 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 Aug 26 03:01:56 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-dd0105e8-dd78-4d55-a97b-07ce62e98f8f req-e40ddcd1-7564-4a58-bfab-d71439b64b67 tempest-ServerActionsTestOtherA-319111576 None] attachment_update completed successfully. Aug 26 03:01:56 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5" returned: 0 in 0.424s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:56 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b Aug 26 03:01:56 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Creating offline snapshot b92c14b0-7a9b-4655-a6ad-9ea516947660 of volume 97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8457722c-d40d-4bf1-a1ff-7ba1af4aa691]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:57 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" returned: 0 in 0.545s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:57 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b Aug 26 03:01:57 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:57 devstack sudo[101032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da Aug 26 03:01:57 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:57 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5.bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" returned: 0 in 0.359s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-bbe89759-6fec-4ec9-9a1a-eb76c9ffd33b" released by "_delete_snapshot" :: held 2.047s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-630716ef-8994-4014-8803-db7fab6b81e5" released by "delete_snapshot" :: held 2.110s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:58 devstack cinder-volume[94506]: WARNING cinder.quota [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-513086414 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-513086414, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:58 devstack cinder-volume[94506]: WARNING cinder.quota [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-513086414 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-513086414, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:58 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da" returned: 0 in 0.592s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:58 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 1G Aug 26 03:01:58 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['d1914ef5-e5ed-4200-b838-8983dfa72596', '490277b5-d5f1-4f2a-9efc-2654e77dc3f2', 'b195123c-823a-4829-82a3-c55390906efb', '5a884d3d-8801-46fc-adea-4fe1382d8963'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-75e85d9f-32ca-4b9b-b759-a00df66c29f6 tempest-GroupSnapshotsTest-1617530097 None] group_snapshot 36684a07-6fae-4fbd-9fb9-27a7e35d9888: deleted successfully Aug 26 03:01:58 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 1G" returned: 0 in 0.620s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2719e-f029-47f5-a8fa-31a43045f4da -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:58 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2719e-f029-47f5-a8fa-31a43045f4da -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 Aug 26 03:01:58 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "cinder-quobyte-630716ef-8994-4014-8803-db7fab6b81e5" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-630716ef-8994-4014-8803-db7fab6b81e5" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9815b90a-add1-485c-b6b3-8ef26d1846af]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:01:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:58 devstack sudo[101048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 Aug 26 03:01:58 devstack sudo[101048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:59 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97e2719e-f029-47f5-a8fa-31a43045f4da -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660" returned: 0 in 0.462s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:59 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 is being set with open permissions: ugo+rw Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:59 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 Aug 26 03:01:59 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:59 devstack sudo[101048]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5" returned: 0 in 0.488s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:59 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5 Aug 26 03:01:59 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:59 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660" returned: 0 in 0.347s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:59 devstack sudo[101061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info Aug 26 03:01:59 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:59 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-630716ef-8994-4014-8803-db7fab6b81e5" returned: 0 in 0.337s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Lock "cinder-quobyte-630716ef-8994-4014-8803-db7fab6b81e5" released by "delete_volume" :: held 0.926s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['0190f202-96df-4157-8144-b5986b5d56ed'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:01:59 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info" returned: 0 in 0.360s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:01:59 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info is being set with open permissions: ugo+rw Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:01:59 devstack cinder-volume[94506]: WARNING cinder.quota [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-513086414 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-513086414, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:01:59 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info Aug 26 03:01:59 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:01:59 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Created reservations ['628d7f74-b447-496f-a606-31a5f7fcd473', '38eb8db1-22d7-4731-9053-cabacb3824e5', '06c6f697-10f3-47f8-8e21-dbe08f701f1e', 'ee153258-4438-4ac0-b7e1-aa9024a032bd'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:00 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:00 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:00 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.info" returned: 0 in 0.478s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0aff2285-949a-4e70-b15e-2c9c6b0d40a9 tempest-VolumesDeleteCascade-681479385 None] Create snapshot completed successfully Aug 26 03:02:00 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.379s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:00 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e44e8b31-47e3-497b-ab40-c80072cbb5bf tempest-GroupSnapshotsTest-1617530097 None] Delete group completed successfully. Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Flow 'volume_create_manager' (7641488f-64ff-4954-b07a-a0fe295b14cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eadb670-f094-4f2a-b43e-de44b4c54d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0eadb670-f094-4f2a-b43e-de44b4c54d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-252128161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d819c259-9e00-4272-b9d5-cf39c271e4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d01c7671e105423daa2cff29ce5a0e5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b92c14b0-7a9b-4655-a6ad-9ea516947660,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:01Z,use_quota=True,user_id='049e891aa7134f2ba1952ec48256f9ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8191b0-daf8-479b-b3e0-f4eced22bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8191b0-daf8-479b-b3e0-f4eced22bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44cd306-a08c-4978-9ad3-bf92f1f29455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44cd306-a08c-4978-9ad3-bf92f1f29455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd819c259-9e00-4272-b9d5-cf39c271e4ff', 'volume_name': 'volume-d819c259-9e00-4272-b9d5-cf39c271e4ff', 'volume_size': 1, 'snapshot_id': 'b92c14b0-7a9b-4655-a6ad-9ea516947660'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e483bfa-4998-49ae-b096-0bf48037c9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e483bfa-4998-49ae-b096-0bf48037c9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6649496-b4a5-485b-82d9-95454848d824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:01 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Volume d819c259-9e00-4272-b9d5-cf39c271e4ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d819c259-9e00-4272-b9d5-cf39c271e4ff', 'volume_size': 1, 'snapshot_id': 'b92c14b0-7a9b-4655-a6ad-9ea516947660'} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-b92c14b0-7a9b-4655-a6ad-9ea516947660-d819c259-9e00-4272-b9d5-cf39c271e4ff" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-42e40ccf-651e-40aa-9f43-33e69aff3de2 tempest-ServerActionsTestOtherA-319111576 None] Terminate volume connection completed successfully. Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-42e40ccf-651e-40aa-9f43-33e69aff3de2 tempest-ServerActionsTestOtherA-319111576 None] Deleting attachment 5bd3e974-8d49-4ff9-935e-c97628d4cf0b. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-b92c14b0-7a9b-4655-a6ad-9ea516947660-d819c259-9e00-4272-b9d5-cf39c271e4ff" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Creating volume d819c259-9e00-4272-b9d5-cf39c271e4ff from snapshot b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-d819c259-9e00-4272-b9d5-cf39c271e4ff" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-d819c259-9e00-4272-b9d5-cf39c271e4ff" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] snapshot: b92c14b0-7a9b-4655-a6ad-9ea516947660, volume: d819c259-9e00-4272-b9d5-cf39c271e4ff, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd99e9f-a2ce-4eb2-a15d-0dafc013c137]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:01 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 Aug 26 03:02:01 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:02 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660" returned: 0 in 0.886s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2719e-f029-47f5-a8fa-31a43045f4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:02:02 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3995f60b-9c4b-4311-a48a-7c43574f3155]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:02 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da Aug 26 03:02:02 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-b911dd8d-317a-4d4b-9581-e58df10e731b tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:03 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da" returned: 0 in 0.703s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:02:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:02:03 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:02:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:03 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff Aug 26 03:02:03 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff" returned: 0 in 6.575s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:09 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:02:09 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Converted 1024.00 MB image at 155.71 MB/s Aug 26 03:02:09 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff is being set with open permissions: ugo+rw Aug 26 03:02:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:09 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff Aug 26 03:02:09 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:10 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff" returned: 0 in 0.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-d819c259-9e00-4272-b9d5-cf39c271e4ff" released by "_copy_volume_from_snapshot" :: held 8.599s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-b92c14b0-7a9b-4655-a6ad-9ea516947660-d819c259-9e00-4272-b9d5-cf39c271e4ff" released by "_create_volume_from_snapshot" :: held 8.727s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.776s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-b911dd8d-317a-4d4b-9581-e58df10e731b tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.242s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-b911dd8d-317a-4d4b-9581-e58df10e731b tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6649496-b4a5-485b-82d9-95454848d824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d819c259-9e00-4272-b9d5-cf39c271e4ff', 'volume_size': 1, 'snapshot_id': 'b92c14b0-7a9b-4655-a6ad-9ea516947660'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35505fa7-35ef-49c4-8627-efbde59c8b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:10 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Volume volume-d819c259-9e00-4272-b9d5-cf39c271e4ff (d819c259-9e00-4272-b9d5-cf39c271e4ff): created successfully Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35505fa7-35ef-49c4-8627-efbde59c8b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Flow 'volume_create_manager' (7641488f-64ff-4954-b07a-a0fe295b14cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-b911dd8d-317a-4d4b-9581-e58df10e731b tempest-ServerActionsTestOtherA-319111576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dfd7edc9-7017-4d40-8c60-4594534947a2', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:02:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3617c8e7-77a2-4024-a494-fc1f7b7833f7 tempest-VolumesDeleteCascade-681479385 None] Created volume successfully. Aug 26 03:02:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-d8109fa6-0d88-4a7a-a210-46793c85d38a req-b911dd8d-317a-4d4b-9581-e58df10e731b tempest-ServerActionsTestOtherA-319111576 None] attachment_update completed successfully. Aug 26 03:02:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-97e2719e-f029-47f5-a8fa-31a43045f4da-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-97e2719e-f029-47f5-a8fa-31a43045f4da-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Performing cascade delete. {{(pid=94506) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-b92c14b0-7a9b-4655-a6ad-9ea516947660-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-b92c14b0-7a9b-4655-a6ad-9ea516947660-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-97e2719e-f029-47f5-a8fa-31a43045f4da" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-97e2719e-f029-47f5-a8fa-31a43045f4da" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-b92c14b0-7a9b-4655-a6ad-9ea516947660" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-b92c14b0-7a9b-4655-a6ad-9ea516947660" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Deleting offline snapshot b92c14b0-7a9b-4655-a6ad-9ea516947660 of volume 97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] snapshot_file for this snap is: volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d089f-b0a1-49f8-bda6-b098176ff807]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:12 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 Aug 26 03:02:12 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:13 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660" returned: 0 in 0.961s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97e2719e-f029-47f5-a8fa-31a43045f4da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:02:13 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ae3cf1-c64e-48aa-aee0-c62da8a5c63a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:13 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da Aug 26 03:02:13 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:14 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da" returned: 0 in 1.228s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:14 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 Aug 26 03:02:14 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:15 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660" returned: 0 in 0.854s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:15 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660 Aug 26 03:02:15 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:15 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da.b92c14b0-7a9b-4655-a6ad-9ea516947660" returned: 0 in 0.306s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-b92c14b0-7a9b-4655-a6ad-9ea516947660" released by "_delete_snapshot" :: held 3.579s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-97e2719e-f029-47f5-a8fa-31a43045f4da" released by "delete_snapshot" :: held 3.634s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:15 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Created reservations ['8b1f98a8-4147-4a25-b4ee-c3fcc54ed82a', 'f761f9c0-f784-4b0e-ad70-b6254ea132e3', 'db79b865-0bca-4421-b195-7418b8176ebc', '83ada2d8-0599-4e85-87a9-bb6627fa7fd5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Delete snapshot completed successfully. Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-b92c14b0-7a9b-4655-a6ad-9ea516947660-delete_snapshot" released by "delete_snapshot" :: held 3.977s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Snapshots deleted, issuing volume delete {{(pid=94506) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-97e2719e-f029-47f5-a8fa-31a43045f4da" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-97e2719e-f029-47f5-a8fa-31a43045f4da" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ccf55-a381-413b-849b-01e10da261ef]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:16 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da Aug 26 03:02:16 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:16 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da" returned: 0 in 0.793s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:17 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da Aug 26 03:02:17 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:17 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-97e2719e-f029-47f5-a8fa-31a43045f4da" returned: 0 in 0.756s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-97e2719e-f029-47f5-a8fa-31a43045f4da" released by "delete_volume" :: held 1.701s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:17 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Created reservations ['427788c2-0e93-4354-8e8b-d021786832d3', '8c37987a-5a20-495e-a9e7-0aa8accdd93f', 'cb099aa3-1a86-4309-bcf4-dccf07e6577d', 'efdaab7d-02c1-495c-ab25-c4eafc16956a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:18 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:18 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:18 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:18 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Deleted volume successfully. Aug 26 03:02:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74d9bb26-8f17-4e70-bc48-b78cffe98873 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-97e2719e-f029-47f5-a8fa-31a43045f4da-delete_volume" released by "delete_volume" :: held 6.669s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-d819c259-9e00-4272-b9d5-cf39c271e4ff-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-d819c259-9e00-4272-b9d5-cf39c271e4ff-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "cinder-quobyte-d819c259-9e00-4272-b9d5-cf39c271e4ff" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-d819c259-9e00-4272-b9d5-cf39c271e4ff" acquired by "delete_volume" :: waited 0.050s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:19 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4da5e9-08de-4603-9eb7-f832a06fe1e8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:19 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff Aug 26 03:02:19 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:20 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff" returned: 0 in 0.780s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:20 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:20 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:20 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff Aug 26 03:02:20 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:20 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.569s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 8 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:02:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:02:21 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d819c259-9e00-4272-b9d5-cf39c271e4ff" returned: 0 in 0.723s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-quobyte-d819c259-9e00-4272-b9d5-cf39c271e4ff" released by "delete_volume" :: held 1.681s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Created reservations ['179dd895-9cbe-4e6d-bb64-6493c402df4f', 'ff2e3f1f-8de8-42b2-9d69-5321e11ae4f7', '05e6f34c-63e2-491a-9a1b-3ab43975aa4a', '12a50919-3939-4fec-b47c-279ab30f84f3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:21 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:21 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:22 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.669s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:22 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Deleted volume successfully. Aug 26 03:02:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b0bebf55-b83c-4851-94f3-06aa5e88ada1 tempest-VolumesDeleteCascade-681479385 None] Lock "cinder-d819c259-9e00-4272-b9d5-cf39c271e4ff-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Flow 'volume_create_manager' (4d90d682-ba2d-4cf8-9d8f-075ddecc65cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed2dbef-770a-41e0-9788-3b0f265ef5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed2dbef-770a-41e0-9788-3b0f265ef5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-360947175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c21725-c748-406f-a883-3424f6bcad49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da08c326b6d43dfbdd766fcaba5e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:30Z,use_quota=True,user_id='06d88b949e4b4affa88f6865239a3d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88311d14-0a49-4200-8c30-b17e90d97f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88311d14-0a49-4200-8c30-b17e90d97f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71264055-29c1-4eb2-b1b1-adab18f1b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71264055-29c1-4eb2-b1b1-adab18f1b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60c21725-c748-406f-a883-3424f6bcad49', 'volume_name': 'volume-60c21725-c748-406f-a883-3424f6bcad49', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e8c5fa-e0cd-41e0-98e1-04b675fe2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82e8c5fa-e0cd-41e0-98e1-04b675fe2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e1939d-c10a-4296-9d71-1733ba90b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:30 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Volume 60c21725-c748-406f-a883-3424f6bcad49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60c21725-c748-406f-a883-3424f6bcad49', 'volume_size': 1} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-360947175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60c21725-c748-406f-a883-3424f6bcad49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da08c326b6d43dfbdd766fcaba5e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:30Z,use_quota=True,user_id='06d88b949e4b4affa88f6865239a3d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Creating volume 60c21725-c748-406f-a883-3424f6bcad49 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:30 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:30 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 1073741824 Aug 26 03:02:30 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:30 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 1073741824" returned: 0 in 0.604s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=115,cinder:INSERT=26,cinder:UPDATE=116,cinder:DELETE=5 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:02:30 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=123,cinder:UPDATE=114,cinder:INSERT=33,cinder:DELETE=5 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:31 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 Aug 26 03:02:31 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:31 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49" returned: 0 in 0.381s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2e1939d-c10a-4296-9d71-1733ba90b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60c21725-c748-406f-a883-3424f6bcad49', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57980ba6-95df-48a2-8912-e21f703b0109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:31 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Volume volume-60c21725-c748-406f-a883-3424f6bcad49 (60c21725-c748-406f-a883-3424f6bcad49): created successfully Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57980ba6-95df-48a2-8912-e21f703b0109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Flow 'volume_create_manager' (4d90d682-ba2d-4cf8-9d8f-075ddecc65cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:31 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5bfcd198-60da-4143-8527-e1c68b9aa2ad tempest-VolumesTransfersV355Test-1904104623 None] Created volume successfully. Aug 26 03:02:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a6f25032-71ab-4c5f-97a8-41efe052a6d7 tempest-VolumesTransfersV355Test-346775472 None] Transfer volume completed successfully. Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Acquiring lock "cinder-60c21725-c748-406f-a883-3424f6bcad49-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-60c21725-c748-406f-a883-3424f6bcad49-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Acquiring lock "cinder-quobyte-60c21725-c748-406f-a883-3424f6bcad49" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-quobyte-60c21725-c748-406f-a883-3424f6bcad49" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfebe8bc-c2fe-455a-8611-8082ac98d188]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:34 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 Aug 26 03:02:34 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:34 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49" returned: 0 in 0.396s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:34 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49 Aug 26 03:02:34 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:34 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-60c21725-c748-406f-a883-3424f6bcad49" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-quobyte-60c21725-c748-406f-a883-3424f6bcad49" released by "delete_volume" :: held 0.734s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Created reservations ['b8bf8e87-76e9-4380-9ec7-ba8ddb9fd42c', 'a6dfbd9b-a0ed-4d37-bfc4-5c2c85a66f28', 'fee1ecf8-cb98-408f-b976-6d6f829a7d82', '1e5c7a78-07a2-41da-9b1d-527213e57d24'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:34 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:34 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:35 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.367s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Deleted volume successfully. Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3a65f659-b9bf-42f8-b8e5-3517f94ed551 tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-60c21725-c748-406f-a883-3424f6bcad49-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Flow 'volume_create_manager' (da332f7d-658c-4a0c-929b-6730ba8a18bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3c9237-0720-415e-95cf-9fd096ec83f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3c9237-0720-415e-95cf-9fd096ec83f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1188712315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da08c326b6d43dfbdd766fcaba5e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:36Z,use_quota=True,user_id='06d88b949e4b4affa88f6865239a3d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56e946-d74c-4a46-ae9e-fc9c82e63511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d56e946-d74c-4a46-ae9e-fc9c82e63511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41e28ce-5930-4d4c-b8e5-cecdb6c38c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f41e28ce-5930-4d4c-b8e5-cecdb6c38c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac', 'volume_name': 'volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af7c980-2926-4171-b7ad-4f50fe5b6ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2af7c980-2926-4171-b7ad-4f50fe5b6ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7733883a-1e09-470b-8ee2-a5b36e8bef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Volume 1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac', 'volume_size': 1} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1188712315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da08c326b6d43dfbdd766fcaba5e5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:36Z,use_quota=True,user_id='06d88b949e4b4affa88f6865239a3d40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Creating volume 1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:35 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:02:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:36 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac 1073741824 Aug 26 03:02:36 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Flow 'volume_create_manager' (e39a6a9d-3e48-46c2-9ce5-273f96ff2a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f4f235-f5d9-4890-9e5e-8c5ff7127e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f4f235-f5d9-4890-9e5e-8c5ff7127e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-250942043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2cb7f7-f1a9-4c34-b623-1bc108475d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed52e3814b064d99973f355a66b8b687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:36Z,use_quota=True,user_id='f966e97b80a9425f880bf7c1400d6f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:36 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2762e41e-0d3b-4818-92c2-e1fb75c27a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2762e41e-0d3b-4818-92c2-e1fb75c27a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14725cf9-b941-41de-bad8-fda88aaa3d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14725cf9-b941-41de-bad8-fda88aaa3d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2cb7f7-f1a9-4c34-b623-1bc108475d07', 'volume_name': 'volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de49c266-b1bc-47b0-b364-25e8393fff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de49c266-b1bc-47b0-b364-25e8393fff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b3c24c-342f-49a7-a7e8-5fc398bb3707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Volume 2f2cb7f7-f1a9-4c34-b623-1bc108475d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07', 'volume_size': 1} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac 1073741824" returned: 0 in 0.557s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:36 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac Aug 26 03:02:36 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:36 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac" returned: 0 in 0.285s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-250942043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2cb7f7-f1a9-4c34-b623-1bc108475d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed52e3814b064d99973f355a66b8b687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:36Z,use_quota=True,user_id='f966e97b80a9425f880bf7c1400d6f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Creating volume 2f2cb7f7-f1a9-4c34-b623-1bc108475d07 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:36 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7733883a-1e09-470b-8ee2-a5b36e8bef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:36 devstack sudo[101962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 1073741824 Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b14694-0321-496a-b585-efd110edee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:36 devstack sudo[101962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Volume volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac (1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac): created successfully Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26b14694-0321-496a-b585-efd110edee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Flow 'volume_create_manager' (da332f7d-658c-4a0c-929b-6730ba8a18bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-061e9fc0-e066-44a0-a52f-a34cba775c03 tempest-VolumesTransfersV355Test-1904104623 None] Created volume successfully. Aug 26 03:02:37 devstack sudo[101962]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 1073741824" returned: 0 in 0.497s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:37 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 Aug 26 03:02:37 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:37 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07" returned: 0 in 0.300s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82b3c24c-342f-49a7-a7e8-5fc398bb3707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7728de1-7bda-4799-a294-28966a23f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Volume volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 (2f2cb7f7-f1a9-4c34-b623-1bc108475d07): created successfully Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7728de1-7bda-4799-a294-28966a23f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Flow 'volume_create_manager' (e39a6a9d-3e48-46c2-9ce5-273f96ff2a3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-403fbacb-0ae3-437d-bb18-a6411d22680c tempest-VolumeQuotasAdminTestJSON-1720349606 None] Created volume successfully. Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Acquiring lock "cinder-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Acquiring lock "cinder-quobyte-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-quobyte-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ce11f9-da65-4d7d-a97d-4327bce1ec28]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:38 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac Aug 26 03:02:38 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "cinder-2f2cb7f7-f1a9-4c34-b623-1bc108475d07-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "cinder-2f2cb7f7-f1a9-4c34-b623-1bc108475d07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "cinder-quobyte-2f2cb7f7-f1a9-4c34-b623-1bc108475d07" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "cinder-quobyte-2f2cb7f7-f1a9-4c34-b623-1bc108475d07" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[189a781d-33c1-4410-9c6e-d8d04477a575]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:38 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 Aug 26 03:02:38 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:38 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:38 devstack sudo[101978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac Aug 26 03:02:38 devstack sudo[101978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:39 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07" returned: 0 in 0.398s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:39 devstack sudo[101978]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:39 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07 Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac" returned: 0 in 0.281s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:39 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-quobyte-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac" released by "delete_volume" :: held 0.759s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Created reservations ['1229a868-2756-415f-a331-9dd2b20a040f', '1561bb19-511a-492d-8aa8-9ac9dfb40200', '74831440-59cc-4633-a2be-8a8e20160aaf', '059598b9-3669-4c88-a7c7-86e60549a47e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:39 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:39 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:39 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2f2cb7f7-f1a9-4c34-b623-1bc108475d07" returned: 0 in 0.337s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "cinder-quobyte-2f2cb7f7-f1a9-4c34-b623-1bc108475d07" released by "delete_volume" :: held 0.783s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Created reservations ['82faf020-98b6-4b77-b8cf-1018a6c2620e', '948d80af-208a-4919-a3f7-4ad2f9c8fc36', '102755fe-4117-41c2-b86f-bf0d715d80cb', 'afd29728-ef26-4624-8147-9a64e6ef56a0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:39 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.323s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:39 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Deleted volume successfully. Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d1d89063-d713-415e-85a7-1b15424976ca tempest-VolumesTransfersV355Test-552878922 None] Lock "cinder-1f20ef6c-1dd4-4f8e-ac13-ad7ce64ed7ac-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:39 devstack sudo[101990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:39 devstack sudo[101990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:40 devstack sudo[101990]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.296s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Deleted volume successfully. Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ad99956f-0cf9-4ccf-a177-6c397b06497b tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "cinder-2f2cb7f7-f1a9-4c34-b623-1bc108475d07-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Flow 'volume_create_manager' (e74ad025-bb69-4685-a5b1-ce40598f8cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f924e408-c0a7-4bd6-9741-6a105ed1a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f924e408-c0a7-4bd6-9741-6a105ed1a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1838314201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3345ad6-8857-42e9-9198-58b6439e13a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed52e3814b064d99973f355a66b8b687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:40Z,use_quota=True,user_id='f966e97b80a9425f880bf7c1400d6f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19192cb3-354d-4402-9eaa-7c7126ab554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19192cb3-354d-4402-9eaa-7c7126ab554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f957bac-45d2-4912-99fb-8bc890ad24b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f957bac-45d2-4912-99fb-8bc890ad24b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3345ad6-8857-42e9-9198-58b6439e13a4', 'volume_name': 'volume-a3345ad6-8857-42e9-9198-58b6439e13a4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01491891-4130-4408-aa63-d9010052ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01491891-4130-4408-aa63-d9010052ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c682a9da-99d4-4b1e-a94b-eacca309d611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Volume a3345ad6-8857-42e9-9198-58b6439e13a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3345ad6-8857-42e9-9198-58b6439e13a4', 'volume_size': 1} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1838314201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3345ad6-8857-42e9-9198-58b6439e13a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed52e3814b064d99973f355a66b8b687',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:40Z,use_quota=True,user_id='f966e97b80a9425f880bf7c1400d6f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Creating volume a3345ad6-8857-42e9-9198-58b6439e13a4 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:40 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:02:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:40 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 1073741824 Aug 26 03:02:40 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:41 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 1073741824" returned: 0 in 0.739s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:41 devstack sudo[102001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 Aug 26 03:02:41 devstack sudo[102001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Flow 'volume_create_manager' (5b117a95-75f9-44af-8e4b-a7ef79a8df6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7de8bad-f822-4e71-a8c0-962c2a2f1851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7de8bad-f822-4e71-a8c0-962c2a2f1851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1968672885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4359b879-0c90-45f3-a3c7-8dd260ccf9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cbaba297c24f4db360d4ef3e89b25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:41Z,use_quota=True,user_id='bea0d21635214a318789e207b02687d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ac7f0e-6115-4dd6-9544-62ff8584bd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ac7f0e-6115-4dd6-9544-62ff8584bd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990b823d-ab7d-4ef8-b1dc-9723b04d6a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (990b823d-ab7d-4ef8-b1dc-9723b04d6a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4359b879-0c90-45f3-a3c7-8dd260ccf9b7', 'volume_name': 'volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53975e9-1633-4db9-8876-c639ddd3658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53975e9-1633-4db9-8876-c639ddd3658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62666396-e531-4027-9887-a9b4257ec3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Volume 4359b879-0c90-45f3-a3c7-8dd260ccf9b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7', 'volume_size': 1} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:41 devstack sudo[102001]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4" returned: 0 in 0.390s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.145s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1968672885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4359b879-0c90-45f3-a3c7-8dd260ccf9b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cbaba297c24f4db360d4ef3e89b25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:41Z,use_quota=True,user_id='bea0d21635214a318789e207b02687d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Creating volume 4359b879-0c90-45f3-a3c7-8dd260ccf9b7 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:41 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:41 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 1073741824 Aug 26 03:02:41 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c682a9da-99d4-4b1e-a94b-eacca309d611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3345ad6-8857-42e9-9198-58b6439e13a4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd2643b-af8b-4e32-a50e-e6b1ead6147e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Volume volume-a3345ad6-8857-42e9-9198-58b6439e13a4 (a3345ad6-8857-42e9-9198-58b6439e13a4): created successfully Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfd2643b-af8b-4e32-a50e-e6b1ead6147e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Flow 'volume_create_manager' (e74ad025-bb69-4685-a5b1-ce40598f8cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6a9d1b92-9826-41b6-bcc4-344fbf4f5edf tempest-VolumeQuotasAdminTestJSON-1720349606 None] Created volume successfully. Aug 26 03:02:42 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 1073741824" returned: 0 in 0.635s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:42 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 Aug 26 03:02:42 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:42 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7" returned: 0 in 0.408s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62666396-e531-4027-9887-a9b4257ec3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a79d5f-abc5-42f5-a4d1-c32902e2b0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:42 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Volume volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 (4359b879-0c90-45f3-a3c7-8dd260ccf9b7): created successfully Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a79d5f-abc5-42f5-a4d1-c32902e2b0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Flow 'volume_create_manager' (5b117a95-75f9-44af-8e4b-a7ef79a8df6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e81683dd-9735-44e4-814a-bddb09800c26 tempest-AttachVolumeNegativeTest-1708312843 None] Created volume successfully. Aug 26 03:02:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5bf6237d-cbbc-437e-9fc9-9c838e08be37 tempest-VolumeQuotasAdminTestJSON-998816847 None] Transfer volume completed successfully. Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3dbc3dde-575e-45de-a84e-765e409aa4df req-b9d57b83-f632-4a4c-a907-8e9586135659 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3dbc3dde-575e-45de-a84e-765e409aa4df req-b9d57b83-f632-4a4c-a907-8e9586135659 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Acquiring lock "cinder-a3345ad6-8857-42e9-9198-58b6439e13a4-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3dbc3dde-575e-45de-a84e-765e409aa4df req-b9d57b83-f632-4a4c-a907-8e9586135659 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Lock "cinder-a3345ad6-8857-42e9-9198-58b6439e13a4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-3dbc3dde-575e-45de-a84e-765e409aa4df req-b9d57b83-f632-4a4c-a907-8e9586135659 tempest-AttachVolumeNegativeTest-1708312843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e5ab337-9ee7-409a-a239-e7bb25e5d57a', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Acquiring lock "cinder-quobyte-a3345ad6-8857-42e9-9198-58b6439e13a4" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Lock "cinder-quobyte-a3345ad6-8857-42e9-9198-58b6439e13a4" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d594ee2-2bc3-4273-8ef1-a0ca74df4b45]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-3dbc3dde-575e-45de-a84e-765e409aa4df req-b9d57b83-f632-4a4c-a907-8e9586135659 tempest-AttachVolumeNegativeTest-1708312843 None] attachment_update completed successfully. Aug 26 03:02:44 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 Aug 26 03:02:44 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:45 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4" returned: 0 in 0.529s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:45 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4 Aug 26 03:02:45 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:45 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3345ad6-8857-42e9-9198-58b6439e13a4" returned: 0 in 0.428s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Lock "cinder-quobyte-a3345ad6-8857-42e9-9198-58b6439e13a4" released by "delete_volume" :: held 1.028s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Created reservations ['bf53c25b-8227-4576-a2be-3037cc9d312e', '8f8e07a7-4219-4869-8f8b-5f68d9676cba', 'e268c225-e3bf-44ea-ad2a-df47e4d1501d', '009278db-c98b-4043-bdb9-0bb3241a7baf'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:45 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:02:45 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:46 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.322s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:46 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:02:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Deleted volume successfully. Aug 26 03:02:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff8c207-9866-41a1-acd7-1e394a7ac98b tempest-VolumeQuotasAdminTestJSON-1271157863 None] Lock "cinder-a3345ad6-8857-42e9-9198-58b6439e13a4-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:02:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-53811207-53d5-4feb-b2dd-2c784e006c8f req-a9585644-9765-4696-ad2d-fa191f9d92aa tempest-ServerActionsTestOtherA-319111576 None] Terminate volume connection completed successfully. Aug 26 03:02:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-53811207-53d5-4feb-b2dd-2c784e006c8f req-a9585644-9765-4696-ad2d-fa191f9d92aa tempest-ServerActionsTestOtherA-319111576 None] Deleting attachment dfd7edc9-7017-4d40-8c60-4594534947a2. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Flow 'volume_create_manager' (9ccda825-9778-4fe1-8b82-38fdf85e5c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35638544-3b46-4f08-95bd-b077134801ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35638544-3b46-4f08-95bd-b077134801ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-460770490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6351c674-153c-46ab-84be-33e07b782037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b99178123345f79e0507bbf6b8c3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:48Z,use_quota=True,user_id='ad0cfa93988b4b8a9e67a3a1e11d8dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ae0c2f-e86f-48c4-b331-0d9ed09a780d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69ae0c2f-e86f-48c4-b331-0d9ed09a780d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f44a2b-c5a8-4b30-9894-200452f4d902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f44a2b-c5a8-4b30-9894-200452f4d902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6351c674-153c-46ab-84be-33e07b782037', 'volume_name': 'volume-6351c674-153c-46ab-84be-33e07b782037', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06983c6a-d79f-4a59-a3f2-bab8fc119c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06983c6a-d79f-4a59-a3f2-bab8fc119c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb37f7a-7d67-44e2-bcaa-7c0b7cb694a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Volume 6351c674-153c-46ab-84be-33e07b782037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6351c674-153c-46ab-84be-33e07b782037', 'volume_size': 1} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-460770490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6351c674-153c-46ab-84be-33e07b782037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b99178123345f79e0507bbf6b8c3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:48Z,use_quota=True,user_id='ad0cfa93988b4b8a9e67a3a1e11d8dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Creating volume 6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:02:47 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:02:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:47 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 1073741824 Aug 26 03:02:47 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:48 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 1073741824" returned: 0 in 0.903s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:48 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 Aug 26 03:02:48 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:49 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037" returned: 0 in 0.426s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb37f7a-7d67-44e2-bcaa-7c0b7cb694a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6351c674-153c-46ab-84be-33e07b782037', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4b5bc1-c177-486e-a925-93af5417cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:49 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Volume volume-6351c674-153c-46ab-84be-33e07b782037 (6351c674-153c-46ab-84be-33e07b782037): created successfully Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd4b5bc1-c177-486e-a925-93af5417cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Flow 'volume_create_manager' (9ccda825-9778-4fe1-8b82-38fdf85e5c88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b0d81ce5-95f0-4b69-b542-4e8d2526e362 tempest-VolumesCloneTest-647416995 None] Created volume successfully. Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Flow 'volume_create_manager' (fc499dc6-c703-4865-818e-6be126964abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec0ba52-3e35-4d22-bea6-3c2f18200f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ec0ba52-3e35-4d22-bea6-3c2f18200f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1206041953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0b99178123345f79e0507bbf6b8c3cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6351c674-153c-46ab-84be-33e07b782037,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:51Z,use_quota=True,user_id='ad0cfa93988b4b8a9e67a3a1e11d8dd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b5d1ae-2037-476b-8f43-ea95a054fa34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b5d1ae-2037-476b-8f43-ea95a054fa34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7f4501-ca90-48ae-a6bc-4a65551c7a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a7f4501-ca90-48ae-a6bc-4a65551c7a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0', 'volume_name': 'volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0', 'volume_size': 2, 'source_volid': '6351c674-153c-46ab-84be-33e07b782037', 'source_volstatus': 'available'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9788b927-e632-4593-84ff-da0db64509d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9788b927-e632-4593-84ff-da0db64509d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f08efd-6f08-43b3-bb31-037337033cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:50 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Volume 85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0', 'volume_size': 2, 'source_volid': '6351c674-153c-46ab-84be-33e07b782037', 'source_volstatus': 'available'} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:50 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Cloning volume 6351c674-153c-46ab-84be-33e07b782037 to volume 85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 Aug 26 03:02:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Creating offline snapshot ddba7a3f-943b-4155-8359-3d8801938e50 of volume 6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:02:51 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda52a30-0e35-4743-aaed-eb0668e6ed38]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:51 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 Aug 26 03:02:51 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:51 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037" returned: 0 in 0.582s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:51 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 1G Aug 26 03:02:51 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:52 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 1G" returned: 0 in 0.690s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6351c674-153c-46ab-84be-33e07b782037 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:52 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6351c674-153c-46ab-84be-33e07b782037 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 Aug 26 03:02:52 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:52 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6351c674-153c-46ab-84be-33e07b782037 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50" returned: 0 in 0.490s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:52 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 is being set with open permissions: ugo+rw Aug 26 03:02:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:52 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 Aug 26 03:02:52 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:53 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50" returned: 0 in 0.342s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:53 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info Aug 26 03:02:53 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:53 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info" returned: 0 in 0.387s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:53 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info is being set with open permissions: ugo+rw Aug 26 03:02:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:53 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info Aug 26 03:02:53 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:54 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.info" returned: 0 in 0.426s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Acquiring lock "cinder-quobyte-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] snapshot: ddba7a3f-943b-4155-8359-3d8801938e50, volume: 85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba01849-9535-419a-86e0-3fd0b5391a5c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:54 devstack sudo[102125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 Aug 26 03:02:54 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:54 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50" returned: 0 in 0.569s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6351c674-153c-46ab-84be-33e07b782037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9847e1bd-ea1b-47fd-b949-87c018e74209]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:02:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:54 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 Aug 26 03:02:54 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:55 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Aug 26 03:02:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037" returned: 0 in 0.683s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:02:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:02:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:02:55 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:02:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:02:55 devstack sudo[102149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 Aug 26 03:02:55 devstack sudo[102149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Flow 'volume_create_manager' (de7b8165-5e90-4c7b-9859-7be55daa39de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ad0d5f-df48-4c8f-9102-178b3efd2d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ad0d5f-df48-4c8f-9102-178b3efd2d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-510648695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3e8a6d-3c03-4e21-88bb-17d8024ef41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b012baec8ed40b1bc7e22fdb5898506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:56Z,use_quota=True,user_id='d731c5690d5b4abfbef4e19cd02ce4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e1b72f-a860-44ae-b782-4701c870be06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e1b72f-a860-44ae-b782-4701c870be06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bac0941-fa46-42b1-9916-70f5f4bfc25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:56 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:02:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bac0941-fa46-42b1-9916-70f5f4bfc25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d3e8a6d-3c03-4e21-88bb-17d8024ef41d', 'volume_name': 'volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cfc582-1ec4-43fc-9f94-90f65bc07c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cfc582-1ec4-43fc-9f94-90f65bc07c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:02:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e6f09-9ea0-4d5a-9470-62814c7cc71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:02:59 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Volume 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:02:59 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Trying to clone 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d from image c93cc321-597b-4580-96b0-992799bdc1cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:03:00 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:03:00 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:03:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[048c08a1-5585-4b4b-83d7-bbf27f8ae7f0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:01 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD Aug 26 03:03:01 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:02 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD" returned: 0 in 1.723s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf is fetched for user d731c5690d5b4abfbef4e19cd02ce4b2. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f5fef3c-6b31-4dfa-9a62-2eda3b532954]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:02 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD Aug 26 03:03:02 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:02 devstack sudo[102149]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" returned: 0 in 7.493s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:03:02 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Converted 1024.00 MB image at 136.64 MB/s Aug 26 03:03:02 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 is being set with open permissions: ugo+rw Aug 26 03:03:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:02 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 Aug 26 03:03:02 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:03 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD" returned: 0 in 0.798s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:03 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" returned: 0 in 0.507s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" released by "_copy_volume_from_snapshot" :: held 9.390s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Acquiring lock "cinder-quobyte-ddba7a3f-943b-4155-8359-3d8801938e50" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-ddba7a3f-943b-4155-8359-3d8801938e50" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Deleting offline snapshot ddba7a3f-943b-4155-8359-3d8801938e50 of volume 6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] snapshot_file for this snap is: volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[25918a2e-5811-4e68-b0c3-8e4651ab8a2a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:03 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 Aug 26 03:03:03 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Flow 'volume_create_manager' (49e15698-d3ce-421a-97fc-b5aca40be162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d87278a-c0a2-40cc-8f79-e8e9be0bf0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d87278a-c0a2-40cc-8f79-e8e9be0bf0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-759187203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849fe4fd-6505-403d-b2eb-274af35e84d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ba8213b451430db4552c6ae8809761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:04Z,use_quota=True,user_id='bb52d589276849a89db97585be81d1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3433baa1-8726-4501-b2f6-89847495f638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3433baa1-8726-4501-b2f6-89847495f638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2f1b65-a007-405f-9355-3806b4bef7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d2f1b65-a007-405f-9355-3806b4bef7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '849fe4fd-6505-403d-b2eb-274af35e84d1', 'volume_name': 'volume-849fe4fd-6505-403d-b2eb-274af35e84d1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0ab48c-0320-4e75-af50-46a0d14f3069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee0ab48c-0320-4e75-af50-46a0d14f3069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a6683a-b6f9-4dd8-9b32-8b7cb2fbf8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:03 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Volume 849fe4fd-6505-403d-b2eb-274af35e84d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-849fe4fd-6505-403d-b2eb-274af35e84d1', 'volume_size': 1} Aug 26 03:03:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:04 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50" returned: 0 in 0.505s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6351c674-153c-46ab-84be-33e07b782037(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:03:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b0f4f7-a0b8-4871-a77e-7fed051a39e1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:04 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 Aug 26 03:03:04 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:04 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037" returned: 0 in 0.557s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:04 devstack sudo[102265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 Aug 26 03:03:04 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:05 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:05 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50 Aug 26 03:03:05 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:05 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037.ddba7a3f-943b-4155-8359-3d8801938e50" returned: 0 in 0.326s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-ddba7a3f-943b-4155-8359-3d8801938e50" released by "_delete_snapshot" :: held 1.979s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.583s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-510648695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d3e8a6d-3c03-4e21-88bb-17d8024ef41d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b012baec8ed40b1bc7e22fdb5898506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:02:56Z,use_quota=True,user_id='d731c5690d5b4abfbef4e19cd02ce4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Creating volume 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:05 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8f08efd-6f08-43b3-bb31-037337033cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0', 'volume_size': 2, 'source_volid': '6351c674-153c-46ab-84be-33e07b782037', 'source_volstatus': 'available'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab0b101-d3f3-482f-a85f-717a9e140be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:05 devstack sudo[102275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d 1073741824 Aug 26 03:03:05 devstack sudo[102275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Volume volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 (85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0): created successfully Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aab0b101-d3f3-482f-a85f-717a9e140be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Flow 'volume_create_manager' (fc499dc6-c703-4865-818e-6be126964abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a1e0d47a-99d9-4d09-8344-44368246949a tempest-VolumesCloneTest-647416995 None] Created volume successfully. Aug 26 03:03:06 devstack sudo[102275]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d 1073741824" returned: 0 in 0.697s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:06 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d Aug 26 03:03:06 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:06 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" returned: 0 in 0.317s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.802s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-759187203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=849fe4fd-6505-403d-b2eb-274af35e84d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27ba8213b451430db4552c6ae8809761',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:04Z,use_quota=True,user_id='bb52d589276849a89db97585be81d1dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Creating volume 849fe4fd-6505-403d-b2eb-274af35e84d1 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:06 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:06 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 1073741824 Aug 26 03:03:06 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Attempting download of c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd8151d-80f3-4ce1-add6-b05fbbffc296]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Acquiring lock "cinder-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Lock "cinder-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:07 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p Aug 26 03:03:07 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Acquiring lock "cinder-quobyte-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" acquired by "delete_volume" :: waited 0.044s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c0976-a641-4e13-8c67-bb53815bb0fd]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:07 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 Aug 26 03:03:07 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:07 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p" returned: 0 in 0.852s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:08 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 1073741824" returned: 0 in 1.307s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:08 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p Aug 26 03:03:08 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 Aug 26 03:03:08 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:08 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:08 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" returned: 0 in 0.877s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:08 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0 Aug 26 03:03:08 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:08 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p" returned: 1 in 0.790s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_nqnepl7p' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c3cd1d-e912-4cba-bc75-c1c1358f0c35]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:08 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD Aug 26 03:03:08 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:08 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" returned: 0 in 0.679s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1" returned: 0 in 0.773s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.218s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0" released by "delete_volume" :: held 1.687s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a6683a-b6f9-4dd8-9b32-8b7cb2fbf8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-849fe4fd-6505-403d-b2eb-274af35e84d1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b879e325-91cb-4d95-ab84-c4de655a9498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:09 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Volume volume-849fe4fd-6505-403d-b2eb-274af35e84d1 (849fe4fd-6505-403d-b2eb-274af35e84d1): created successfully Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b879e325-91cb-4d95-ab84-c4de655a9498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Flow 'volume_create_manager' (49e15698-d3ce-421a-97fc-b5aca40be162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-548b5b66-6603-45da-9e32-b87ce2696f45 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Created volume successfully. Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Created reservations ['75d14ac9-9964-47c3-8b9e-4ed426a5e511', '49d9c64e-d6ec-4954-b292-7e293d092c50', 'ea35d90a-ef14-4dca-b4d5-8a9865022e15', '4b60665c-abd9-4429-9955-33386d02d498'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:09 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD" returned: 0 in 0.859s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] c93cc321-597b-4580-96b0-992799bdc1cf was qcow2, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:03:09 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:09 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:09 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d Aug 26 03:03:09 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Acquiring lock "cinder-6351c674-153c-46ab-84be-33e07b782037-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Lock "cinder-6351c674-153c-46ab-84be-33e07b782037-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Acquiring lock "cinder-quobyte-6351c674-153c-46ab-84be-33e07b782037" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-6351c674-153c-46ab-84be-33e07b782037" acquired by "delete_volume" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:10 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.756s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Deleted volume successfully. Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35b0f43-9a29-4b52-b827-f088a4872d1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8c18f164-3260-4404-b7b4-48aaae6cbda2 tempest-VolumesCloneTest-647416995 None] Lock "cinder-85ddcab7-8a44-4b4b-b28a-e8e27daf4ba0-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:10 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 Aug 26 03:03:10 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:10 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037" returned: 0 in 0.768s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:11 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037 Aug 26 03:03:11 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:11 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6351c674-153c-46ab-84be-33e07b782037" returned: 0 in 0.531s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Lock "cinder-quobyte-6351c674-153c-46ab-84be-33e07b782037" released by "delete_volume" :: held 1.485s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Acquiring lock "cinder-849fe4fd-6505-403d-b2eb-274af35e84d1-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Created reservations ['6ba84d13-14af-44e7-b5c5-7098a5e41bb6', 'a2e03846-a67a-45aa-be5c-ff77aedec577', '8afb2f07-f21f-465b-b491-2c25cd690df3', '2ed96f6f-e518-4693-915a-96a81e89c22e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "cinder-849fe4fd-6505-403d-b2eb-274af35e84d1-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Acquiring lock "cinder-quobyte-849fe4fd-6505-403d-b2eb-274af35e84d1" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "cinder-quobyte-849fe4fd-6505-403d-b2eb-274af35e84d1" acquired by "delete_volume" :: waited 0.066s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:11 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:11 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99e8c7-2482-4a96-8211-e4ce174f692a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:12 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 Aug 26 03:03:12 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:12 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.316s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Deleted volume successfully. Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5e943e1-e266-43c9-b702-d7a7ae4325f6 tempest-VolumesCloneTest-647416995 None] Lock "cinder-6351c674-153c-46ab-84be-33e07b782037-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:12 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1" returned: 0 in 0.522s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:12 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1 Aug 26 03:03:12 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:12 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" returned: 0 in 3.016s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_1dpqfn39devstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:03:12 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Converted 112.00 MB image at 37.12 MB/s Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:12 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d 1G Aug 26 03:03:12 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:12 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-849fe4fd-6505-403d-b2eb-274af35e84d1" returned: 0 in 0.475s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "cinder-quobyte-849fe4fd-6505-403d-b2eb-274af35e84d1" released by "delete_volume" :: held 1.055s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:12 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Created reservations ['29c084fd-3548-4a12-8487-c651e89673ef', '1fa895e6-202b-44fb-a1c5-37b218dbe9de', 'e890b21c-cdb3-43b3-b9cf-5e3533a429d5', '07b2326f-c3f3-44df-9262-6b62309f9ce4'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:12 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d 1G" returned: 0 in 0.500s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Downloaded image c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf for user d731c5690d5b4abfbef4e19cd02ce4b2 is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Marking volume 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Copying metadata from image c93cc321-597b-4580-96b0-992799bdc1cf to 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Creating volume glance metadata for volume 2d3e8a6d-3c03-4e21-88bb-17d8024ef41d backed by image c93cc321-597b-4580-96b0-992799bdc1cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:13 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:13 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e6f09-9ea0-4d5a-9470-62814c7cc71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bef695-2899-46a2-abd0-3efb74df7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:13 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Volume volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d (2d3e8a6d-3c03-4e21-88bb-17d8024ef41d): created successfully Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bef695-2899-46a2-abd0-3efb74df7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Flow 'volume_create_manager' (de7b8165-5e90-4c7b-9859-7be55daa39de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:13 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e21e0aa7-94d7-4162-9273-fdda57fe8e53 tempest-ServerActionsTestOtherA-319111576 None] Created volume successfully. Aug 26 03:03:13 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.418s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:13 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Deleted volume successfully. Aug 26 03:03:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9bd7635f-4315-4ad6-b7ed-5c8235d4c4b6 tempest-VolumeQuotasNegativeTestJSON-206781073 None] Lock "cinder-849fe4fd-6505-403d-b2eb-274af35e84d1-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Flow 'volume_create_manager' (54646295-d06a-47dd-ae7e-d55fda47ec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d644a6-6d46-4501-92a5-68b30696126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1d644a6-6d46-4501-92a5-68b30696126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1843002047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265be3d2-d4d7-43ee-b3ec-b2f3761e2d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd9aba12e74764b5f07a4b4cc50495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:17Z,use_quota=True,user_id='f3070a421f694b4f8b226e3c9a9142f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403f1924-9186-4b23-91d5-a7c85e79402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403f1924-9186-4b23-91d5-a7c85e79402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e757a61e-239c-4ce1-b76a-724a705b2e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e757a61e-239c-4ce1-b76a-724a705b2e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265be3d2-d4d7-43ee-b3ec-b2f3761e2d57', 'volume_name': 'volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57', 'volume_size': 2}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3f1053-93fa-4537-85b4-20eece6c4b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3f1053-93fa-4537-85b4-20eece6c4b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ee2742-3d77-4866-bd37-8f8d33eae893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Volume 265be3d2-d4d7-43ee-b3ec-b2f3761e2d57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57', 'volume_size': 2} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1843002047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265be3d2-d4d7-43ee-b3ec-b2f3761e2d57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fd9aba12e74764b5f07a4b4cc50495',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:17Z,use_quota=True,user_id='f3070a421f694b4f8b226e3c9a9142f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Creating volume 265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:17 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 2147483648 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:17 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 2147483648 Aug 26 03:03:17 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d66705e7-83a7-4f2e-a3e6-a2d530579274 req-e0790374-d057-412f-8e0b-a486daf95e47 tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:18 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 2147483648" returned: 0 in 1.089s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:18 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 Aug 26 03:03:18 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:19 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57" returned: 0 in 0.318s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d66705e7-83a7-4f2e-a3e6-a2d530579274 req-e0790374-d057-412f-8e0b-a486daf95e47 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.053s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93ee2742-3d77-4866-bd37-8f8d33eae893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57', 'volume_size': 2}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8e8a55-c568-4b71-bb0f-043ed648c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Volume volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 (265be3d2-d4d7-43ee-b3ec-b2f3761e2d57): created successfully Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a8e8a55-c568-4b71-bb0f-043ed648c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Flow 'volume_create_manager' (54646295-d06a-47dd-ae7e-d55fda47ec33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d66705e7-83a7-4f2e-a3e6-a2d530579274 req-e0790374-d057-412f-8e0b-a486daf95e47 tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a708b9cf-b30b-467c-a887-6449ac88114f tempest-VolumesCloneNegativeTest-863520566 None] Created volume successfully. Aug 26 03:03:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-d66705e7-83a7-4f2e-a3e6-a2d530579274 req-e0790374-d057-412f-8e0b-a486daf95e47 tempest-ServerActionsTestOtherA-319111576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e65147c-86c0-43e0-8b71-891e5c8828e7', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:03:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-d66705e7-83a7-4f2e-a3e6-a2d530579274 req-e0790374-d057-412f-8e0b-a486daf95e47 tempest-ServerActionsTestOtherA-319111576 None] attachment_update completed successfully. Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:20 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:20 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:20 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Acquiring lock "cinder-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Lock "cinder-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Acquiring lock "cinder-quobyte-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Lock "cinder-quobyte-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19ad202-800c-4e65-a34d-f8b08b63df92]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:21 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 Aug 26 03:03:21 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:21 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57" returned: 0 in 0.488s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:21 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57 Aug 26 03:03:21 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:21 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57" returned: 0 in 0.545s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Lock "cinder-quobyte-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57" released by "delete_volume" :: held 1.103s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Created reservations ['281d8a00-5722-4fab-951a-f978daf12b52', '3b62a642-c7ae-49c5-a236-0f39606400fa', 'ee5675fd-e80e-4564-bf89-275ebcfc7ce0', 'd787c9d6-18e1-4dcf-b53a-551ca7dee32e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:22 devstack sudo[102542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:22 devstack sudo[102542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:22 devstack sudo[102542]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.379s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Deleted volume successfully. Aug 26 03:03:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1634a3bc-944b-475d-bcd8-4dc4787a65cb tempest-VolumesCloneNegativeTest-863520566 None] Lock "cinder-265be3d2-d4d7-43ee-b3ec-b2f3761e2d57-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Flow 'volume_create_manager' (bc57b683-1d52-4f12-aa3e-9d1bcd835b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d214f7-b70f-4ea8-b2ca-690fd6a9800a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51d214f7-b70f-4ea8-b2ca-690fd6a9800a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2120434915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5219ad5-8bda-41eb-8126-9a20324a95c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda7b7774e814857a0e011142c597dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:24Z,use_quota=True,user_id='37cdf7ba0b72417b94e7ce2f994acf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90907b36-45c1-4f65-b635-4aab3e4abed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90907b36-45c1-4f65-b635-4aab3e4abed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcba400e-4158-461c-a776-65a792d61a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcba400e-4158-461c-a776-65a792d61a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5219ad5-8bda-41eb-8126-9a20324a95c4', 'volume_name': 'volume-a5219ad5-8bda-41eb-8126-9a20324a95c4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d37ec38-bf25-4095-9f7d-af8613b30334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d37ec38-bf25-4095-9f7d-af8613b30334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a33e9-65ef-4598-b221-ae12f1250244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:24 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Volume a5219ad5-8bda-41eb-8126-9a20324a95c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5219ad5-8bda-41eb-8126-9a20324a95c4', 'volume_size': 1} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2120434915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5219ad5-8bda-41eb-8126-9a20324a95c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda7b7774e814857a0e011142c597dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:24Z,use_quota=True,user_id='37cdf7ba0b72417b94e7ce2f994acf84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Creating volume a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:24 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:24 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 1073741824 Aug 26 03:03:24 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:24 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 1073741824" returned: 0 in 0.796s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:25 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 Aug 26 03:03:25 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:25 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a33e9-65ef-4598-b221-ae12f1250244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5219ad5-8bda-41eb-8126-9a20324a95c4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987fb476-19a1-438f-a390-90e69c643a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:25 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Volume volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 (a5219ad5-8bda-41eb-8126-9a20324a95c4): created successfully Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987fb476-19a1-438f-a390-90e69c643a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Flow 'volume_create_manager' (bc57b683-1d52-4f12-aa3e-9d1bcd835b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ac73b8a4-d527-43cb-b468-162c2de73f47 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Created volume successfully. Aug 26 03:03:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Creating offline snapshot 22b05415-ec8c-4cc9-b965-1e14f023d130 of volume a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:03:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[535192a7-d72b-4197-b36c-89da1322985f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:27 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 Aug 26 03:03:27 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:28 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4" returned: 0 in 1.105s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:28 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 1G Aug 26 03:03:28 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (3db7b109-da25-442b-9596-9ec4cba44366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c0044c-adda-4d74-837f-21530d2966b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c0044c-adda-4d74-837f-21530d2966b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1496767178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0867fc9-28bd-4cdc-821f-dbe5de9e245e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:29Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487eb217-c029-4736-a024-33350d836c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (487eb217-c029-4736-a024-33350d836c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355edfa0-313e-4403-92fb-bfa61b891f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:29 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355edfa0-313e-4403-92fb-bfa61b891f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0867fc9-28bd-4cdc-821f-dbe5de9e245e', 'volume_name': 'volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f4b346-69ef-43ae-ad0c-adc1a97bb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21f4b346-69ef-43ae-ad0c-adc1a97bb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ef1772-c718-427d-b9b9-1122880aeb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:29 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Volume b0867fc9-28bd-4cdc-821f-dbe5de9e245e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e', 'volume_size': 1} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 1G" returned: 0 in 1.431s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:29 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 Aug 26 03:03:29 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:30 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130" returned: 0 in 0.815s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:30 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 is being set with open permissions: ugo+rw Aug 26 03:03:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:30 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 Aug 26 03:03:30 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:31 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130" returned: 0 in 0.640s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:31 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=99,cinder:INSERT=32,cinder:UPDATE=101,cinder:DELETE=10 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:03:31 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=105,cinder:SELECT=79,cinder:INSERT=26,cinder:DELETE=9 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:03:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:31 devstack sudo[102641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info Aug 26 03:03:31 devstack sudo[102641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:31 devstack sudo[102641]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info" returned: 0 in 0.621s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:31 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info is being set with open permissions: ugo+rw Aug 26 03:03:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:31 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info Aug 26 03:03:31 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:32 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.info" returned: 0 in 0.518s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.393s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.765s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1496767178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0867fc9-28bd-4cdc-821f-dbe5de9e245e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:29Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Creating volume b0867fc9-28bd-4cdc-821f-dbe5de9e245e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:32 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:32 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e 1073741824 Aug 26 03:03:32 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f59be211-c92d-4dce-8271-78cbe429d286 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Create snapshot completed successfully Aug 26 03:03:33 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e 1073741824" returned: 0 in 1.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:33 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e Aug 26 03:03:33 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:34 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e" returned: 0 in 0.591s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ef1772-c718-427d-b9b9-1122880aeb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6c463-1064-4130-bd71-9eba3e16f022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:34 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Volume volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e (b0867fc9-28bd-4cdc-821f-dbe5de9e245e): created successfully Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf6c463-1064-4130-bd71-9eba3e16f022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (3db7b109-da25-442b-9596-9ec4cba44366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:34 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-65db3533-91bf-4dcd-9e70-059fde05d2c6 tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "cinder-22b05415-ec8c-4cc9-b965-1e14f023d130-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-22b05415-ec8c-4cc9-b965-1e14f023d130-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "cinder-quobyte-a5219ad5-8bda-41eb-8126-9a20324a95c4" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-quobyte-a5219ad5-8bda-41eb-8126-9a20324a95c4" acquired by "delete_snapshot" :: waited 0.043s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "cinder-quobyte-22b05415-ec8c-4cc9-b965-1e14f023d130" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-quobyte-22b05415-ec8c-4cc9-b965-1e14f023d130" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Deleting offline snapshot 22b05415-ec8c-4cc9-b965-1e14f023d130 of volume a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] snapshot_file for this snap is: volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d4de37-66ae-4d29-99f0-5dfd015fed55]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:35 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 Aug 26 03:03:35 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:36 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130" returned: 0 in 1.049s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5219ad5-8bda-41eb-8126-9a20324a95c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0565d478-9008-42e5-84f1-7c473b17cad3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:36 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 Aug 26 03:03:36 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (de1078e6-5d4f-4681-909f-086652717e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657fdc79-47ff-45dc-b8fb-23b5808ab6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657fdc79-47ff-45dc-b8fb-23b5808ab6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1457911187',display_name='tempest-VolumesGetTest-Volume-1015325082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ebb43e-1ac9-4814-9d89-49abdfa132f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:36Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570fda9a-271a-4dbd-a234-e32d2d3786d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570fda9a-271a-4dbd-a234-e32d2d3786d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a368f78-1ff8-475b-922d-ef96cc6eb1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a368f78-1ff8-475b-922d-ef96cc6eb1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ebb43e-1ac9-4814-9d89-49abdfa132f2', 'volume_name': 'volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf727e4-02c0-4263-bf0b-0efaf51f247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf727e4-02c0-4263-bf0b-0efaf51f247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673a19df-7617-40fc-b726-3ddc3045bad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Volume 15ebb43e-1ac9-4814-9d89-49abdfa132f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2', 'volume_size': 1} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1457911187',display_name='tempest-VolumesGetTest-Volume-1015325082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ebb43e-1ac9-4814-9d89-49abdfa132f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:36Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Creating volume 15ebb43e-1ac9-4814-9d89-49abdfa132f2 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:36 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:36 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 1073741824 Aug 26 03:03:36 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:37 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4" returned: 0 in 0.841s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:37 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 Aug 26 03:03:37 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:37 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 1073741824" returned: 0 in 0.979s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:37 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 Aug 26 03:03:37 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:38 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130" returned: 0 in 0.992s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:38 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130 Aug 26 03:03:38 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:38 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2" returned: 0 in 0.368s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (673a19df-7617-40fc-b726-3ddc3045bad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bf48a4-ad41-4dea-881a-e505148a0229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Volume volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 (15ebb43e-1ac9-4814-9d89-49abdfa132f2): created successfully Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bf48a4-ad41-4dea-881a-e505148a0229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (de1078e6-5d4f-4681-909f-086652717e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-03588f69-3935-49b2-aa61-c0b98172395f tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:03:38 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4.22b05415-ec8c-4cc9-b965-1e14f023d130" returned: 0 in 0.518s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-4ee6a59b-200f-4f17-a852-a43037e6b98b req-f79bb8f8-2be9-4bde-b01f-b2e7fd9892e3 tempest-AttachVolumeNegativeTest-1708312843 None] Terminate volume connection completed successfully. Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-4ee6a59b-200f-4f17-a852-a43037e6b98b req-f79bb8f8-2be9-4bde-b01f-b2e7fd9892e3 tempest-AttachVolumeNegativeTest-1708312843 None] Deleting attachment 2e5ab337-9ee7-409a-a239-e7bb25e5d57a. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-quobyte-22b05415-ec8c-4cc9-b965-1e14f023d130" released by "_delete_snapshot" :: held 3.642s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-quobyte-a5219ad5-8bda-41eb-8126-9a20324a95c4" released by "delete_snapshot" :: held 3.690s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Created reservations ['2278bba7-c346-4d89-884f-dc893a30d3db', 'f5a6691a-e5a3-4037-b1fb-e22b226d9002', '796f64c4-61b9-4481-9780-63806a981400', 'bf1724e0-1302-43b1-ad9a-d9a8a93582a8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Delete snapshot completed successfully. Aug 26 03:03:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-185ea6f6-540f-497d-a104-950fae292ec5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-22b05415-ec8c-4cc9-b965-1e14f023d130-delete_snapshot" released by "delete_snapshot" :: held 3.985s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "cinder-a5219ad5-8bda-41eb-8126-9a20324a95c4-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-a5219ad5-8bda-41eb-8126-9a20324a95c4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "cinder-quobyte-a5219ad5-8bda-41eb-8126-9a20324a95c4" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-quobyte-a5219ad5-8bda-41eb-8126-9a20324a95c4" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-15ebb43e-1ac9-4814-9d89-49abdfa132f2-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccaf9e8-e2ab-47cc-9742-99c910529740]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Lock "cinder-15ebb43e-1ac9-4814-9d89-49abdfa132f2-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-15ebb43e-1ac9-4814-9d89-49abdfa132f2" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:39 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 Aug 26 03:03:39 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-15ebb43e-1ac9-4814-9d89-49abdfa132f2" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadcf5d0-cf5e-4375-a724-86e6918aaad1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-19529879-25c2-49ab-9224-76de9904b750 tempest-ServerActionsTestOtherA-319111576 None] Terminate volume connection completed successfully. Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-19529879-25c2-49ab-9224-76de9904b750 tempest-ServerActionsTestOtherA-319111576 None] Deleting attachment 8e65147c-86c0-43e0-8b71-891e5c8828e7. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:03:40 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 Aug 26 03:03:40 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:40 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4" returned: 0 in 0.749s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:40 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4 Aug 26 03:03:40 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:40 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2" returned: 0 in 0.692s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:40 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2 Aug 26 03:03:40 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:41 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5219ad5-8bda-41eb-8126-9a20324a95c4" returned: 0 in 0.554s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-quobyte-a5219ad5-8bda-41eb-8126-9a20324a95c4" released by "delete_volume" :: held 1.475s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Created reservations ['01d652c8-e490-42f0-a291-c719c28c58e7', '3f004ccd-a489-43e9-b3ad-dced11e5c934', 'ff839124-abef-4cd9-ace8-cce0d42d6629', '875de7f6-dab1-4d5d-a14b-926e39a7b316'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:41 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15ebb43e-1ac9-4814-9d89-49abdfa132f2" returned: 0 in 0.451s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-15ebb43e-1ac9-4814-9d89-49abdfa132f2" released by "delete_volume" :: held 1.241s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:41 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:41 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Created reservations ['108149dc-58c5-41cb-80cf-f90a5ef07cd2', '8f81d8a9-4c51-439b-906d-d91713992daa', '56296722-af61-4036-99e0-41e42df913d4', '7ae7dbaf-868d-4493-a21e-2909482f705e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:41 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:41 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:41 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.542s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Deleted volume successfully. Aug 26 03:03:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a4459fb3-983b-4d6b-8d6d-510a90531a69 tempest-VolumeSnapshotQuotasNegativeTestJSON-1789776062 None] Lock "cinder-a5219ad5-8bda-41eb-8126-9a20324a95c4-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:42 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.585s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-26b1b708-50a2-4bb6-af30-4243faa98917 tempest-VolumesGetTest-586531176 None] Lock "cinder-15ebb43e-1ac9-4814-9d89-49abdfa132f2-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-b0867fc9-28bd-4cdc-821f-dbe5de9e245e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Lock "cinder-b0867fc9-28bd-4cdc-821f-dbe5de9e245e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-b0867fc9-28bd-4cdc-821f-dbe5de9e245e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-b0867fc9-28bd-4cdc-821f-dbe5de9e245e" acquired by "delete_volume" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[92936684-8fc7-471c-a23d-be721d0e2d93]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:42 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e Aug 26 03:03:42 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:43 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:43 devstack sudo[102779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e Aug 26 03:03:43 devstack sudo[102779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:43 devstack sudo[102779]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0867fc9-28bd-4cdc-821f-dbe5de9e245e" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-b0867fc9-28bd-4cdc-821f-dbe5de9e245e" released by "delete_volume" :: held 0.858s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Created reservations ['62abc8d4-542f-4bb8-bd73-68f5395d1712', '46974650-84e0-4c7b-a19a-0c4d10719b35', '15f5b1e6-3a64-4636-a0bb-f2585e6b9f6b', 'a41cba7f-8084-4f03-8d96-5726bcffbfb4'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:43 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:03:43 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:44 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:03:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5b014901-ad50-4bd1-abe9-affeeba1559d tempest-VolumesGetTest-586531176 None] Lock "cinder-b0867fc9-28bd-4cdc-821f-dbe5de9e245e-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (312a989d-193d-4503-b674-1bacfee36d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55499e86-5dba-4f92-add9-3a128cb7a7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55499e86-5dba-4f92-add9-3a128cb7a7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-641034634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d3167c-1c39-40e9-9401-d595d142e9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:44Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3be44b-dae0-441e-a2b9-9fe057e78928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3be44b-dae0-441e-a2b9-9fe057e78928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0a509b-6762-439e-8e2e-2f067f735a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0a509b-6762-439e-8e2e-2f067f735a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72d3167c-1c39-40e9-9401-d595d142e9b5', 'volume_name': 'volume-72d3167c-1c39-40e9-9401-d595d142e9b5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8e49fd-d584-4a7a-98ca-f6eff88056d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8e49fd-d584-4a7a-98ca-f6eff88056d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614d2297-ab34-4650-b0c4-1ee207218f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:44 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Volume 72d3167c-1c39-40e9-9401-d595d142e9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72d3167c-1c39-40e9-9401-d595d142e9b5', 'volume_size': 1} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-641034634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72d3167c-1c39-40e9-9401-d595d142e9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:44Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Creating volume 72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:03:44 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:03:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:44 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 1073741824 Aug 26 03:03:44 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-ae75a1c9-be0e-4e21-b0cd-ed432345dd5e tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:45 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 1073741824" returned: 0 in 0.875s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:45 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 Aug 26 03:03:45 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:46 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5" returned: 0 in 0.414s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-ae75a1c9-be0e-4e21-b0cd-ed432345dd5e tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.957s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614d2297-ab34-4650-b0c4-1ee207218f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72d3167c-1c39-40e9-9401-d595d142e9b5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def7da82-e589-4962-95ab-485de734726d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-ae75a1c9-be0e-4e21-b0cd-ed432345dd5e tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Volume volume-72d3167c-1c39-40e9-9401-d595d142e9b5 (72d3167c-1c39-40e9-9401-d595d142e9b5): created successfully Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def7da82-e589-4962-95ab-485de734726d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (312a989d-193d-4503-b674-1bacfee36d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d7009855-1778-428d-9b72-13ee3eb8e869 tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:03:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-ae75a1c9-be0e-4e21-b0cd-ed432345dd5e tempest-ServerActionsTestOtherA-319111576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cd8dee9a-5114-4580-bc58-5f76ea7a71c6', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:03:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-f46d4282-e5e6-4886-9897-0000d4cefadf req-ae75a1c9-be0e-4e21-b0cd-ed432345dd5e tempest-ServerActionsTestOtherA-319111576 None] attachment_update completed successfully. Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (8edb6e59-44f7-4d70-a5ae-242d8eed6465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a43bd9-de0b-4260-b214-d0ab163592c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a43bd9-de0b-4260-b214-d0ab163592c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1525822245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e22140b-46f9-4d08-ae49-313347b41db9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=72d3167c-1c39-40e9-9401-d595d142e9b5,status='creating',terminated_at=None,updated_at=2026-08-26T01:03:48Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91368fbf-c2ca-4861-9e86-b2c8136d9712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91368fbf-c2ca-4861-9e86-b2c8136d9712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b568283-0dae-4d98-bfaf-6797be12c5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b568283-0dae-4d98-bfaf-6797be12c5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6e22140b-46f9-4d08-ae49-313347b41db9', 'volume_name': 'volume-6e22140b-46f9-4d08-ae49-313347b41db9', 'volume_size': 1, 'source_volid': '72d3167c-1c39-40e9-9401-d595d142e9b5', 'source_volstatus': 'available'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a40c6dc-2370-48ba-88b8-923d418dd61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a40c6dc-2370-48ba-88b8-923d418dd61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5165d3f-f267-4f2d-af9c-fa77251285c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:03:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Volume 6e22140b-46f9-4d08-ae49-313347b41db9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6e22140b-46f9-4d08-ae49-313347b41db9', 'volume_size': 1, 'source_volid': '72d3167c-1c39-40e9-9401-d595d142e9b5', 'source_volstatus': 'available'} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:48 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Cloning volume 72d3167c-1c39-40e9-9401-d595d142e9b5 to volume 6e22140b-46f9-4d08-ae49-313347b41db9 Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Creating offline snapshot 455155e9-b464-4b39-a700-654dc21c156d of volume 72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca44ad6-ae8d-4b5c-9c2c-712564038afc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:48 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 Aug 26 03:03:48 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:49 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5" returned: 0 in 0.529s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:49 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d 1G Aug 26 03:03:49 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:49 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d 1G" returned: 0 in 0.808s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d3167c-1c39-40e9-9401-d595d142e9b5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:49 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d3167c-1c39-40e9-9401-d595d142e9b5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d Aug 26 03:03:49 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:50 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72d3167c-1c39-40e9-9401-d595d142e9b5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d" returned: 0 in 0.733s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:50 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d is being set with open permissions: ugo+rw Aug 26 03:03:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:50 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d Aug 26 03:03:50 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:51 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d" returned: 0 in 0.458s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:51 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info Aug 26 03:03:51 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:51 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info" returned: 0 in 0.564s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:51 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info is being set with open permissions: ugo+rw Aug 26 03:03:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:51 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info Aug 26 03:03:51 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:52 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.info" returned: 0 in 0.679s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-6e22140b-46f9-4d08-ae49-313347b41db9" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-6e22140b-46f9-4d08-ae49-313347b41db9" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] snapshot: 455155e9-b464-4b39-a700-654dc21c156d, volume: 6e22140b-46f9-4d08-ae49-313347b41db9, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[86092580-09df-44b9-acb1-c19e7ba79225]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:52 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d Aug 26 03:03:52 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d" returned: 0 in 0.712s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d3167c-1c39-40e9-9401-d595d142e9b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:03:53 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:53 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f67f31-6f73-4246-b313-c715a2351fbf]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:03:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:53 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 Aug 26 03:03:53 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:03:54 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Aug 26 03:03:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5" returned: 0 in 0.884s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:03:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:03:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:03:54 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:03:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:03:54 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 Aug 26 03:03:54 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:01 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=44,cinder:UPDATE=39,cinder:INSERT=14,cinder:DELETE=4 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:04:01 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=44,cinder:SELECT=35,cinder:DELETE=3,cinder:INSERT=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:04:03 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9" returned: 0 in 9.021s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5, size 1024.00 MB, duration 9.02 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:04:03 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Converted 1024.00 MB image at 113.50 MB/s Aug 26 03:04:03 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 is being set with open permissions: ugo+rw Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:03 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 Aug 26 03:04:03 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:03 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9" returned: 0 in 0.340s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-6e22140b-46f9-4d08-ae49-313347b41db9" released by "_copy_volume_from_snapshot" :: held 11.154s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-455155e9-b464-4b39-a700-654dc21c156d" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-455155e9-b464-4b39-a700-654dc21c156d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Deleting offline snapshot 455155e9-b464-4b39-a700-654dc21c156d of volume 72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] snapshot_file for this snap is: volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efa48a4-a096-486a-9eea-6469b28425f9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:04 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d Aug 26 03:04:04 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:04 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d" returned: 0 in 0.889s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72d3167c-1c39-40e9-9401-d595d142e9b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:04:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[46262ea6-bfd1-4a19-b34c-00a7421ccffd]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:04 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 Aug 26 03:04:04 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:05 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5" returned: 0 in 1.103s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:05 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d Aug 26 03:04:05 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:06 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d" returned: 0 in 0.667s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:06 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d Aug 26 03:04:06 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:07 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5.455155e9-b464-4b39-a700-654dc21c156d" returned: 0 in 0.477s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-455155e9-b464-4b39-a700-654dc21c156d" released by "_delete_snapshot" :: held 3.299s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.706s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5165d3f-f267-4f2d-af9c-fa77251285c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e22140b-46f9-4d08-ae49-313347b41db9', 'volume_size': 1, 'source_volid': '72d3167c-1c39-40e9-9401-d595d142e9b5', 'source_volstatus': 'available'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b4b8cb-7de5-4506-aab2-6cbd6503cd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:07 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Volume volume-6e22140b-46f9-4d08-ae49-313347b41db9 (6e22140b-46f9-4d08-ae49-313347b41db9): created successfully Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b4b8cb-7de5-4506-aab2-6cbd6503cd93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (8edb6e59-44f7-4d70-a5ae-242d8eed6465) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a13f438e-38f8-41d7-8cde-40a000d45060 tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (23d7742d-6478-44db-8c99-ce689dfd6f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf0a8b0-ed14-4d3d-9799-f78b6a14ab49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf0a8b0-ed14-4d3d-9799-f78b6a14ab49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539515409',display_name='tempest-VolumesGetTest-Volume-180334585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348c5c5b-fa37-418c-9d7f-7072401e7dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:10Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97cd842-cf7f-481c-ba50-a206c306fc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a97cd842-cf7f-481c-ba50-a206c306fc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ae9eb9-467b-4713-91a9-e87d78238dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75ae9eb9-467b-4713-91a9-e87d78238dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348c5c5b-fa37-418c-9d7f-7072401e7dd1', 'volume_name': 'volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df3da56-5b63-4cce-b241-08cd45b59ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df3da56-5b63-4cce-b241-08cd45b59ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f329989e-4ffd-4a14-b302-7a7d0280263b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:10 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Volume 348c5c5b-fa37-418c-9d7f-7072401e7dd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1', 'volume_size': 1} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-539515409',display_name='tempest-VolumesGetTest-Volume-180334585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=348c5c5b-fa37-418c-9d7f-7072401e7dd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:10Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Creating volume 348c5c5b-fa37-418c-9d7f-7072401e7dd1 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:10 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:10 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 1073741824 Aug 26 03:04:10 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:11 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 1073741824" returned: 0 in 1.110s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:11 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 Aug 26 03:04:11 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:12 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f329989e-4ffd-4a14-b302-7a7d0280263b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca6b368-9eba-477f-a305-9862e81df655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:12 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Volume volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 (348c5c5b-fa37-418c-9d7f-7072401e7dd1): created successfully Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dca6b368-9eba-477f-a305-9862e81df655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (23d7742d-6478-44db-8c99-ce689dfd6f4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0e7c737e-6834-43fe-bf3f-e149159bf255 tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:04:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-348c5c5b-fa37-418c-9d7f-7072401e7dd1-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Lock "cinder-348c5c5b-fa37-418c-9d7f-7072401e7dd1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-348c5c5b-fa37-418c-9d7f-7072401e7dd1" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-348c5c5b-fa37-418c-9d7f-7072401e7dd1" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:13 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76017db-44b6-4eea-9e46-a3d1181583ce]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:13 devstack sudo[103515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 Aug 26 03:04:13 devstack sudo[103515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:14 devstack sudo[103515]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1" returned: 0 in 0.538s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:14 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1 Aug 26 03:04:14 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:14 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-348c5c5b-fa37-418c-9d7f-7072401e7dd1" returned: 0 in 0.375s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-348c5c5b-fa37-418c-9d7f-7072401e7dd1" released by "delete_volume" :: held 0.970s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Created reservations ['1c8e77dd-8c75-4582-abe0-7544689b85d0', '67c1adc5-38b9-4932-8e76-17c62a9792f2', 'ffd4234f-7530-4802-b675-ec6d06976fac', 'b3b54bba-451f-469f-a0ee-d8a57db74f58'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:14 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:14 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:15 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.354s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:15 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:15 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:04:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8bb50aec-c1b1-4f0a-8c5d-7c348451d024 tempest-VolumesGetTest-586531176 None] Lock "cinder-348c5c5b-fa37-418c-9d7f-7072401e7dd1-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-6e22140b-46f9-4d08-ae49-313347b41db9-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Lock "cinder-6e22140b-46f9-4d08-ae49-313347b41db9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-6e22140b-46f9-4d08-ae49-313347b41db9" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-6e22140b-46f9-4d08-ae49-313347b41db9" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7e2412-57a1-4756-abc7-5bdb594ee7d4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:16 devstack sudo[103530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 Aug 26 03:04:16 devstack sudo[103530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:16 devstack sudo[103530]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9" returned: 0 in 0.472s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:16 devstack sudo[103535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9 Aug 26 03:04:16 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:17 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6e22140b-46f9-4d08-ae49-313347b41db9" returned: 0 in 0.326s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-6e22140b-46f9-4d08-ae49-313347b41db9" released by "delete_volume" :: held 0.852s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Created reservations ['7743dcd6-000d-42da-9991-40907478fd7f', 'f0bd8eb9-2dbc-44a6-9f02-d77d4f41ada7', '1a79ccee-5393-4be3-8166-1cc595303b8b', '6a13f6d2-3e20-41df-b426-976777e34cc4'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:17 devstack sudo[103540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:17 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-72d3167c-1c39-40e9-9401-d595d142e9b5-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Lock "cinder-72d3167c-1c39-40e9-9401-d595d142e9b5-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Flow 'volume_create_manager' (2a0a3472-512f-4fb2-8da2-11de8155dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1530d4a-260c-4c6a-a554-5f1ce7fe1dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1530d4a-260c-4c6a-a554-5f1ce7fe1dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1463407988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd73e969-c06b-48fd-9162-ab728d06922c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955825efd54a405599fd8b054ff75b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:17Z,use_quota=True,user_id='589d72b6a21d4cfa8d273b57f923ba9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcc2dd7-56d1-4f99-9067-59212ab53830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fcc2dd7-56d1-4f99-9067-59212ab53830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6951832f-b8bd-446c-9245-a12c9ef580de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-72d3167c-1c39-40e9-9401-d595d142e9b5" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-72d3167c-1c39-40e9-9401-d595d142e9b5" acquired by "delete_volume" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:17 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.572s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b9c2b9-97e5-44c1-a0fd-267f0fb6ac6b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cf6196ba-68e8-4b50-98cf-b08d286f89c0 tempest-VolumesGetTest-586531176 None] Lock "cinder-6e22140b-46f9-4d08-ae49-313347b41db9-delete_volume" released by "delete_volume" :: held 1.854s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:18 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 Aug 26 03:04:18 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6951832f-b8bd-446c-9245-a12c9ef580de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd73e969-c06b-48fd-9162-ab728d06922c', 'volume_name': 'volume-dd73e969-c06b-48fd-9162-ab728d06922c', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f2604a-71c9-4eb7-abbc-75b8a32dc937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9f2604a-71c9-4eb7-abbc-75b8a32dc937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a601359-5e1d-4232-aaa5-5e64df25d9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:18 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Volume dd73e969-c06b-48fd-9162-ab728d06922c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd73e969-c06b-48fd-9162-ab728d06922c', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Trying to clone dd73e969-c06b-48fd-9162-ab728d06922c from image c93cc321-597b-4580-96b0-992799bdc1cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:04:18 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5" returned: 0 in 0.731s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:18 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5 Aug 26 03:04:18 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:04:18 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[da101a0f-71eb-4a39-99bb-97c7213cb033]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:19 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-72d3167c-1c39-40e9-9401-d595d142e9b5" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-72d3167c-1c39-40e9-9401-d595d142e9b5" released by "delete_volume" :: held 1.238s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:19 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD Aug 26 03:04:19 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Created reservations ['609e122c-16fe-48ff-957e-f0bba248aac9', '30a2c329-e33f-4f50-b7a7-97034776aa03', '89dbfa68-be91-4d18-b68e-99d917f3eb3a', '28579eae-353b-4479-bf86-39a1e04412c7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:19 devstack sudo[103560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:19 devstack sudo[103560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:19 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf is fetched for user 589d72b6a21d4cfa8d273b57f923ba9e. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ead990-6fbb-4d6f-a150-298adad50899]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:19 devstack sudo[103560]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.497s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:04:19 devstack sudo[103566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD Aug 26 03:04:19 devstack sudo[103566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-eac838d1-6445-4bb2-9934-b717c55e3011 tempest-VolumesGetTest-586531176 None] Lock "cinder-72d3167c-1c39-40e9-9401-d595d142e9b5-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:20 devstack sudo[103566]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1463407988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd73e969-c06b-48fd-9162-ab728d06922c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955825efd54a405599fd8b054ff75b16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:17Z,use_quota=True,user_id='589d72b6a21d4cfa8d273b57f923ba9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Creating volume dd73e969-c06b-48fd-9162-ab728d06922c {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:20 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c 1073741824 Aug 26 03:04:20 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:20 devstack sudo[103575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:20 devstack sudo[103575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:20 devstack sudo[103575]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.336s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:04:20 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c 1073741824" returned: 0 in 0.648s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:20 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c Aug 26 03:04:20 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:21 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c" returned: 0 in 0.418s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Attempting download of c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume dd73e969-c06b-48fd-9162-ab728d06922c. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (d51d1488-3b39-4016-9b7e-f53c718d6601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ad75d-a939-409b-9e65-40ad5875ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324ad75d-a939-409b-9e65-40ad5875ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461342419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baeb3432-7f46-4ebd-9872-533623f1a75d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:21Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d12918-a84d-4e39-baef-2ef3433d7732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d12918-a84d-4e39-baef-2ef3433d7732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ac3f38-f2d6-4033-9923-a10d3b5f6e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[812a6cf5-9e74-4c59-8193-e9e04bbf9426]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:21 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes Aug 26 03:04:21 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ac3f38-f2d6-4033-9923-a10d3b5f6e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'baeb3432-7f46-4ebd-9872-533623f1a75d', 'volume_name': 'volume-baeb3432-7f46-4ebd-9872-533623f1a75d', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1f4468-6b9e-4252-87b7-d1e9dec43e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e1f4468-6b9e-4252-87b7-d1e9dec43e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5565a0-6e84-4a71-9425-2eba9ad0f9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Volume baeb3432-7f46-4ebd-9872-533623f1a75d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-baeb3432-7f46-4ebd-9872-533623f1a75d', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Trying to clone baeb3432-7f46-4ebd-9872-533623f1a75d from image c93cc321-597b-4580-96b0-992799bdc1cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes" returned: 0 in 0.436s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:22 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes Aug 26 03:04:22 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:04:22 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:04:22 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes" returned: 1 in 0.629s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_cexdhpes' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[af378b71-cbb6-48b4-96b4-8e6f031926a3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58d60f9-139c-4bce-a7c3-c82720836b33]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:22 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD Aug 26 03:04:22 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:22 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD Aug 26 03:04:22 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:23 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD" returned: 0 in 0.551s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] c93cc321-597b-4580-96b0-992799bdc1cf was qcow2, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:23 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf is fetched for user 6d143ccfb3924a06a198a45913c84375. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:04:23 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c Aug 26 03:04:23 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fcc2c2-a89f-467a-a40e-6ffba9c9a58d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:23 devstack sudo[103638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD Aug 26 03:04:23 devstack sudo[103638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:23 devstack sudo[103638]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-461342419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baeb3432-7f46-4ebd-9872-533623f1a75d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:21Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Creating volume baeb3432-7f46-4ebd-9872-533623f1a75d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:23 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:23 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d 1073741824 Aug 26 03:04:23 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:24 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d 1073741824" returned: 0 in 0.714s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:24 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d Aug 26 03:04:24 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:25 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d" returned: 0 in 0.384s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Attempting download of c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume baeb3432-7f46-4ebd-9872-533623f1a75d. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2545f4e1-ee50-4791-80d8-12cb63b3e443]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:25 devstack sudo[103665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7 Aug 26 03:04:25 devstack sudo[103665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-e774f4a5-26a3-445e-9561-94415d501c46 req-4c5b652b-a01c-4a4e-a0ed-70964615af3f tempest-ServerActionsTestOtherA-319111576 None] Terminate volume connection completed successfully. Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-e774f4a5-26a3-445e-9561-94415d501c46 req-4c5b652b-a01c-4a4e-a0ed-70964615af3f tempest-ServerActionsTestOtherA-319111576 None] Deleting attachment cd8dee9a-5114-4580-bc58-5f76ea7a71c6. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:04:25 devstack sudo[103665]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7" returned: 0 in 0.603s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "cinder-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "cinder-quobyte-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-quobyte-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:26 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7 Aug 26 03:04:26 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5363b-c186-4319-b1c9-d01f8936114a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:26 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c" returned: 0 in 3.319s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_hv2m3zuhdevstack@QuobyteHD, size 112.00 MB, duration 3.32 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:04:26 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Converted 112.00 MB image at 33.73 MB/s Aug 26 03:04:26 devstack sudo[103691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d Aug 26 03:04:26 devstack sudo[103691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:26 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c 1G Aug 26 03:04:26 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:26 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7" returned: 1 in 0.657s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_v75e3is7' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab95e93-f641-4fa0-8f43-56dd66e6b132]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:26 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD Aug 26 03:04:26 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:26 devstack sudo[103691]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" returned: 0 in 0.682s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:26 devstack sudo[103704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d Aug 26 03:04:26 devstack sudo[103704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:27 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c 1G" returned: 0 in 0.589s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Downloaded image c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume dd73e969-c06b-48fd-9162-ab728d06922c successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf for user 589d72b6a21d4cfa8d273b57f923ba9e is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Marking volume dd73e969-c06b-48fd-9162-ab728d06922c as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Copying metadata from image c93cc321-597b-4580-96b0-992799bdc1cf to dd73e969-c06b-48fd-9162-ab728d06922c. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Creating volume glance metadata for volume dd73e969-c06b-48fd-9162-ab728d06922c backed by image c93cc321-597b-4580-96b0-992799bdc1cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:04:27 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] c93cc321-597b-4580-96b0-992799bdc1cf was qcow2, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:27 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d Aug 26 03:04:27 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a601359-5e1d-4232-aaa5-5e64df25d9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd73e969-c06b-48fd-9162-ab728d06922c', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690ea2a9-b409-4942-8a75-1300d7294135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:27 devstack sudo[103704]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-quobyte-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d" released by "delete_volume" :: held 1.132s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Volume volume-dd73e969-c06b-48fd-9162-ab728d06922c (dd73e969-c06b-48fd-9162-ab728d06922c): created successfully Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690ea2a9-b409-4942-8a75-1300d7294135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Flow 'volume_create_manager' (2a0a3472-512f-4fb2-8da2-11de8155dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0e374d8f-c5bf-4d6d-92b8-d7a11ceaeea2 tempest-VolumesImageMetadata-1865614897 None] Created volume successfully. Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.quota [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Created reservations ['6d1b2b4e-a3b3-4bf0-b5c5-6e967ed37851', '3dd8e005-3c99-46b7-8e95-88df094456e4', 'de05a171-7e89-464b-8473-1ff4414e7745', '9c7a7c8b-1ff4-4ada-9ba7-6e4f9d39bd45'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:27 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:27 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:27 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.314s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.manager [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Deleted volume successfully. Aug 26 03:04:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-e774f4a5-26a3-445e-9561-94415d501c46 req-5069d319-2a3a-47d2-a3fc-6817c8636a6a tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-2d3e8a6d-3c03-4e21-88bb-17d8024ef41d-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Acquiring lock "cinder-dd73e969-c06b-48fd-9162-ab728d06922c-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Lock "cinder-dd73e969-c06b-48fd-9162-ab728d06922c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "cinder-20e14bea-052e-4be3-85b3-b666ac3c6ce7-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Acquiring lock "cinder-quobyte-dd73e969-c06b-48fd-9162-ab728d06922c" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-20e14bea-052e-4be3-85b3-b666ac3c6ce7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Lock "cinder-quobyte-dd73e969-c06b-48fd-9162-ab728d06922c" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ca45fe-3fe0-4192-9cd3-4d63c8030120]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "cinder-quobyte-20e14bea-052e-4be3-85b3-b666ac3c6ce7" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-quobyte-20e14bea-052e-4be3-85b3-b666ac3c6ce7" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f1d22-c08d-4cd0-8289-cdd689b1a783]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:28 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c Aug 26 03:04:28 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:28 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 Aug 26 03:04:28 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:28 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7" returned: 0 in 0.419s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:28 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c" returned: 0 in 0.504s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:28 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7 Aug 26 03:04:28 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:28 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c Aug 26 03:04:28 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:29 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-20e14bea-052e-4be3-85b3-b666ac3c6ce7" returned: 0 in 0.318s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:29 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dd73e969-c06b-48fd-9162-ab728d06922c" returned: 0 in 0.322s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-quobyte-20e14bea-052e-4be3-85b3-b666ac3c6ce7" released by "delete_volume" :: held 0.797s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Lock "cinder-quobyte-dd73e969-c06b-48fd-9162-ab728d06922c" released by "delete_volume" :: held 0.894s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:29 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d" returned: 0 in 2.137s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_b37y57svdevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:04:29 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Converted 112.00 MB image at 52.39 MB/s Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:29 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d 1G Aug 26 03:04:29 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Created reservations ['fd7897d7-2077-4274-985b-53bff0dc6816', '6d14c639-9c61-4cad-a20d-3c12b78470d5', '868caefd-738f-4276-b322-33944c428b4b', '0346b136-d5fe-472b-87fe-8d6c31f3c75d'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Created reservations ['f3176cb6-a1f3-413b-9392-947446157031', '989c27f1-2240-4917-95d9-c286da18c5c3', 'bc78f9d6-37e5-4b52-b090-922a9a9b9662', '4fca14b0-77ac-4356-b21e-298bc200d0f0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:29 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:29 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:29 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:29 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:29 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d 1G" returned: 0 in 0.494s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Downloaded image c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume baeb3432-7f46-4ebd-9872-533623f1a75d successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf for user 6d143ccfb3924a06a198a45913c84375 is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Marking volume baeb3432-7f46-4ebd-9872-533623f1a75d as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:04:29 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.360s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:29 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Deleted volume successfully. Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Copying metadata from image c93cc321-597b-4580-96b0-992799bdc1cf to baeb3432-7f46-4ebd-9872-533623f1a75d. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Creating volume glance metadata for volume baeb3432-7f46-4ebd-9872-533623f1a75d backed by image c93cc321-597b-4580-96b0-992799bdc1cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-35d54a8f-0ed2-4866-92de-652feec0c20f tempest-ServerActionsTestOtherA-319111576 None] Lock "cinder-20e14bea-052e-4be3-85b3-b666ac3c6ce7-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:29 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.402s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:29 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Deleted volume successfully. Aug 26 03:04:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20d18f07-c7e5-408f-b53d-f97e1572bcc6 tempest-VolumesImageMetadata-1865614897 None] Lock "cinder-dd73e969-c06b-48fd-9162-ab728d06922c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5565a0-6e84-4a71-9425-2eba9ad0f9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baeb3432-7f46-4ebd-9872-533623f1a75d', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448277eb-b3ad-41ce-a98a-a479942ab9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:30 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Volume volume-baeb3432-7f46-4ebd-9872-533623f1a75d (baeb3432-7f46-4ebd-9872-533623f1a75d): created successfully Aug 26 03:04:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448277eb-b3ad-41ce-a98a-a479942ab9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (d51d1488-3b39-4016-9b7e-f53c718d6601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-42133f4b-88bf-4898-bef4-d2677ae3d1d4 tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (fbd64081-b25c-44cb-84a7-345afe70539f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a52530-b51b-4d12-8475-294f9eb331d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5a52530-b51b-4d12-8475-294f9eb331d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-37637014',display_name='tempest-VolumesGetTest-Volume-257598858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd652f2-bf4b-4df1-8c2d-e878584c4628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:32Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d441bff1-40ea-4a58-aebf-e1a1d7f7cdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d441bff1-40ea-4a58-aebf-e1a1d7f7cdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878fd3f3-b85f-4a46-b596-feff96d86916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878fd3f3-b85f-4a46-b596-feff96d86916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdd652f2-bf4b-4df1-8c2d-e878584c4628', 'volume_name': 'volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33655be0-5fec-4fb3-ae35-a86747dba5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33655be0-5fec-4fb3-ae35-a86747dba5bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c48b483-48b6-46be-9820-c1000bc1b42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Volume bdd652f2-bf4b-4df1-8c2d-e878584c4628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628', 'volume_size': 1} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-37637014',display_name='tempest-VolumesGetTest-Volume-257598858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdd652f2-bf4b-4df1-8c2d-e878584c4628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0e63a71f26c4965a37694fa1657827e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:32Z,use_quota=True,user_id='6d143ccfb3924a06a198a45913c84375',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Creating volume bdd652f2-bf4b-4df1-8c2d-e878584c4628 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:32 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:32 devstack sudo[103780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 1073741824 Aug 26 03:04:32 devstack sudo[103780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:33 devstack sudo[103780]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 1073741824" returned: 0 in 0.590s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:33 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 Aug 26 03:04:33 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:33 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c48b483-48b6-46be-9820-c1000bc1b42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a70b7a-b0c6-4212-869c-0390f0f88a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Volume volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 (bdd652f2-bf4b-4df1-8c2d-e878584c4628): created successfully Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a70b7a-b0c6-4212-869c-0390f0f88a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Flow 'volume_create_manager' (fbd64081-b25c-44cb-84a7-345afe70539f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-43a537d9-75a0-4c6b-bd99-f1538cb7cbc7 tempest-VolumesGetTest-586531176 None] Created volume successfully. Aug 26 03:04:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-bdd652f2-bf4b-4df1-8c2d-e878584c4628-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Lock "cinder-bdd652f2-bf4b-4df1-8c2d-e878584c4628-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-bdd652f2-bf4b-4df1-8c2d-e878584c4628" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-bdd652f2-bf4b-4df1-8c2d-e878584c4628" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:34 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9580486-7b0f-4a98-8928-358723a2c2a2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:34 devstack sudo[103791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 Aug 26 03:04:34 devstack sudo[103791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:35 devstack sudo[103791]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628" returned: 0 in 0.476s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:35 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628 Aug 26 03:04:35 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:35 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bdd652f2-bf4b-4df1-8c2d-e878584c4628" returned: 0 in 0.334s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-bdd652f2-bf4b-4df1-8c2d-e878584c4628" released by "delete_volume" :: held 0.889s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Created reservations ['9f09ac6f-eda3-4597-9eab-c811a131a13d', 'ee7614f9-e25a-4b0e-a761-392637be51ab', '91db78dc-87f6-4116-abef-9ba22df850d6', '13908a3f-615a-4bba-b6ad-069cf2b69b12'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:36 devstack sudo[103799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:36 devstack sudo[103799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:36 devstack sudo[103799]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.531s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:36 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:04:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b54ee7d7-b4f5-44d5-b2ec-a1a9766e6cfa tempest-VolumesGetTest-586531176 None] Lock "cinder-bdd652f2-bf4b-4df1-8c2d-e878584c4628-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-baeb3432-7f46-4ebd-9872-533623f1a75d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Lock "cinder-baeb3432-7f46-4ebd-9872-533623f1a75d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Acquiring lock "cinder-quobyte-baeb3432-7f46-4ebd-9872-533623f1a75d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-baeb3432-7f46-4ebd-9872-533623f1a75d" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adf71a8-d32f-4af0-a398-9f0406c38f6e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:37 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d Aug 26 03:04:37 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:37 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d" returned: 0 in 0.475s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:37 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d Aug 26 03:04:37 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:38 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-baeb3432-7f46-4ebd-9872-533623f1a75d" returned: 0 in 0.365s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Lock "cinder-quobyte-baeb3432-7f46-4ebd-9872-533623f1a75d" released by "delete_volume" :: held 0.909s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Created reservations ['ad5cc52f-3695-422e-a023-5ec6a63f1459', '8fdb5989-1bcc-4bd3-88da-cd5fa08cb5a7', '8874e62a-da16-484e-8c72-de7ab2548f1e', 'c3af17e9-d164-4896-ab9b-810a533797e1'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:38 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:38 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Flow 'volume_create_manager' (cae0c762-4730-4715-9796-888fd6a02c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f974f7-0bf7-4fff-a21b-a11825528a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:38 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9f974f7-0bf7-4fff-a21b-a11825528a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-538393644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08be3c8-54a6-4daf-9472-cdf5396ed6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b48e28278d446582b4e01158360cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:39Z,use_quota=True,user_id='49afbe06308f4a5b951e7f810fc79a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2ada9-7862-4010-b3e6-5776894f0858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f2ada9-7862-4010-b3e6-5776894f0858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7398e3c4-31f2-495d-8c65-966b9c484402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7398e3c4-31f2-495d-8c65-966b9c484402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08be3c8-54a6-4daf-9472-cdf5396ed6a1', 'volume_name': 'volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d584e94f-f096-4935-9b88-342ae427f2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d584e94f-f096-4935-9b88-342ae427f2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f707485-7afe-4f67-83b6-5c38f044e82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Volume a08be3c8-54a6-4daf-9472-cdf5396ed6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1', 'volume_size': 1} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-538393644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08be3c8-54a6-4daf-9472-cdf5396ed6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b48e28278d446582b4e01158360cc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:39Z,use_quota=True,user_id='49afbe06308f4a5b951e7f810fc79a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Creating volume a08be3c8-54a6-4daf-9472-cdf5396ed6a1 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:38 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.437s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Deleted volume successfully. Aug 26 03:04:38 devstack sudo[103817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 1073741824 Aug 26 03:04:38 devstack sudo[103817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3b7a34ef-6406-403e-94aa-c227dacd8c48 tempest-VolumesGetTest-586531176 None] Lock "cinder-baeb3432-7f46-4ebd-9872-533623f1a75d-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Flow 'volume_create_manager' (fdbce603-e7be-4b02-afe0-43657eb8f9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ea1fdf-67a4-4d77-97ff-ffd7066f41e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ea1fdf-67a4-4d77-97ff-ffd7066f41e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-904155175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2783cae-c79b-4dd4-a1d1-5fa6917feb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cbaba297c24f4db360d4ef3e89b25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:39Z,use_quota=True,user_id='bea0d21635214a318789e207b02687d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55971478-4f8d-4048-8691-95e0e176731c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55971478-4f8d-4048-8691-95e0e176731c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c2d509-1043-4236-b705-dbcd86c49fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70c2d509-1043-4236-b705-dbcd86c49fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2783cae-c79b-4dd4-a1d1-5fa6917feb7b', 'volume_name': 'volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba39542-b1e1-465e-8a5c-1d3000132357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba39542-b1e1-465e-8a5c-1d3000132357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a151737-f45d-49cd-a905-7f69828357e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Volume b2783cae-c79b-4dd4-a1d1-5fa6917feb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b', 'volume_size': 1} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:39 devstack sudo[103817]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 1073741824" returned: 0 in 0.668s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:39 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 Aug 26 03:04:39 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:39 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1" returned: 0 in 0.346s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-904155175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2783cae-c79b-4dd4-a1d1-5fa6917feb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cbaba297c24f4db360d4ef3e89b25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:39Z,use_quota=True,user_id='bea0d21635214a318789e207b02687d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Creating volume b2783cae-c79b-4dd4-a1d1-5fa6917feb7b {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:39 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f707485-7afe-4f67-83b6-5c38f044e82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed026ea3-abc4-4926-b7d2-225853ff89ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:39 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b 1073741824 Aug 26 03:04:39 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Volume volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 (a08be3c8-54a6-4daf-9472-cdf5396ed6a1): created successfully Aug 26 03:04:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed026ea3-abc4-4926-b7d2-225853ff89ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Flow 'volume_create_manager' (cae0c762-4730-4715-9796-888fd6a02c1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9f8e9244-ff03-43ab-9212-ef1be34f6098 tempest-VolumesMetadataTest-340669717 None] Created volume successfully. Aug 26 03:04:40 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b 1073741824" returned: 0 in 0.720s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:40 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b Aug 26 03:04:40 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:41 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b" returned: 0 in 0.430s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a151737-f45d-49cd-a905-7f69828357e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f01316-ad69-4970-9403-add28b8289db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Volume volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b (b2783cae-c79b-4dd4-a1d1-5fa6917feb7b): created successfully Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f01316-ad69-4970-9403-add28b8289db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Flow 'volume_create_manager' (fdbce603-e7be-4b02-afe0-43657eb8f9df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3e1df002-3fd9-4508-b0da-4cd69a9a8e67 tempest-AttachVolumeNegativeTest-1708312843 None] Created volume successfully. Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Acquiring lock "cinder-a08be3c8-54a6-4daf-9472-cdf5396ed6a1-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Lock "cinder-a08be3c8-54a6-4daf-9472-cdf5396ed6a1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Acquiring lock "cinder-quobyte-a08be3c8-54a6-4daf-9472-cdf5396ed6a1" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Lock "cinder-quobyte-a08be3c8-54a6-4daf-9472-cdf5396ed6a1" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a39eb5-2a13-4750-b827-8aac3b52af89]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:42 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 Aug 26 03:04:42 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:42 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1" returned: 0 in 0.493s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:42 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1 Aug 26 03:04:42 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:43 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a08be3c8-54a6-4daf-9472-cdf5396ed6a1" returned: 0 in 0.430s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Lock "cinder-quobyte-a08be3c8-54a6-4daf-9472-cdf5396ed6a1" released by "delete_volume" :: held 1.002s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Created reservations ['e568db09-5e03-422b-912c-0fbfb64aab38', 'c2130528-40c0-40a6-b461-9799ce577ef3', '82a28a33-9b89-4477-ba8b-1c30acf6b535', '546ec27b-4e48-4012-8dbb-d6f318c03638'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:43 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:43 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d98ca505-68d6-42a4-ae03-052769d7641d req-c1d4db40-fae3-4388-b1f8-4841f0c5850d tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d98ca505-68d6-42a4-ae03-052769d7641d req-c1d4db40-fae3-4388-b1f8-4841f0c5850d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-d98ca505-68d6-42a4-ae03-052769d7641d req-c1d4db40-fae3-4388-b1f8-4841f0c5850d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-d98ca505-68d6-42a4-ae03-052769d7641d req-c1d4db40-fae3-4388-b1f8-4841f0c5850d tempest-AttachVolumeNegativeTest-1708312843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74d5439c-dfd9-4379-a642-48ad3d0b6866', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:04:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-d98ca505-68d6-42a4-ae03-052769d7641d req-c1d4db40-fae3-4388-b1f8-4841f0c5850d tempest-AttachVolumeNegativeTest-1708312843 None] attachment_update completed successfully. Aug 26 03:04:43 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.395s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Deleted volume successfully. Aug 26 03:04:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d640f7cf-540f-4251-b74e-8fcd687b1017 tempest-VolumesMetadataTest-340669717 None] Lock "cinder-a08be3c8-54a6-4daf-9472-cdf5396ed6a1-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-c042b6d8-4a85-4acd-880f-d1cfd4c0dc1f req-538059b9-6dd1-4705-a9c9-031b151f35a8 tempest-AttachVolumeNegativeTest-1708312843 None] Terminate volume connection completed successfully. Aug 26 03:04:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-c042b6d8-4a85-4acd-880f-d1cfd4c0dc1f req-538059b9-6dd1-4705-a9c9-031b151f35a8 tempest-AttachVolumeNegativeTest-1708312843 None] Deleting attachment 74d5439c-dfd9-4379-a642-48ad3d0b6866. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Flow 'volume_create_manager' (72069479-8134-43a0-8963-78001611072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb29d3a-227f-4422-90a6-07f4a3b258a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bb29d3a-227f-4422-90a6-07f4a3b258a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-402585793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0271fc0c-2f06-44dd-8fde-282eaec382c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d685b618f64aca93c2d373f41545c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:53Z,use_quota=True,user_id='1915c3fc4b1142e889e5d3e0570afc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a3865-109e-4140-a0a3-37b7873db88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a3865-109e-4140-a0a3-37b7873db88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c261b5-33ad-4c39-9f23-1c14a07317f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c261b5-33ad-4c39-9f23-1c14a07317f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0271fc0c-2f06-44dd-8fde-282eaec382c1', 'volume_name': 'volume-0271fc0c-2f06-44dd-8fde-282eaec382c1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f692170-af6e-4e09-bb2b-dc692fde079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f692170-af6e-4e09-bb2b-dc692fde079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3553f442-a11d-4900-8d51-f228141ddf10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:52 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Volume 0271fc0c-2f06-44dd-8fde-282eaec382c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0271fc0c-2f06-44dd-8fde-282eaec382c1', 'volume_size': 1} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-402585793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0271fc0c-2f06-44dd-8fde-282eaec382c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d685b618f64aca93c2d373f41545c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:53Z,use_quota=True,user_id='1915c3fc4b1142e889e5d3e0570afc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Creating volume 0271fc0c-2f06-44dd-8fde-282eaec382c1 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:53 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:53 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 1073741824 Aug 26 03:04:53 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 1073741824" returned: 0 in 0.587s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:53 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 Aug 26 03:04:53 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:53 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3553f442-a11d-4900-8d51-f228141ddf10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0271fc0c-2f06-44dd-8fde-282eaec382c1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2364734-0986-41fc-8946-7c8f4dd7746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Volume volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 (0271fc0c-2f06-44dd-8fde-282eaec382c1): created successfully Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2364734-0986-41fc-8946-7c8f4dd7746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Flow 'volume_create_manager' (72069479-8134-43a0-8963-78001611072e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b32ef52d-0d81-44e4-b2db-47617e2b0361 tempest-VolumesTransfersV357Test-1537695506 None] Created volume successfully. Aug 26 03:04:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3e816314-70b8-4653-9fce-8d235f75c227 tempest-VolumesTransfersV357Test-1317297751 None] Transfer volume completed successfully. Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Acquiring lock "cinder-0271fc0c-2f06-44dd-8fde-282eaec382c1-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-0271fc0c-2f06-44dd-8fde-282eaec382c1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Acquiring lock "cinder-quobyte-0271fc0c-2f06-44dd-8fde-282eaec382c1" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-quobyte-0271fc0c-2f06-44dd-8fde-282eaec382c1" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a4c4a7-ea87-408c-a14e-b1401de84005]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:56 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 Aug 26 03:04:56 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:56 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1" returned: 0 in 0.515s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:57 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1 Aug 26 03:04:57 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:57 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0271fc0c-2f06-44dd-8fde-282eaec382c1" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-quobyte-0271fc0c-2f06-44dd-8fde-282eaec382c1" released by "delete_volume" :: held 0.933s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Created reservations ['c13674b1-ac7e-4873-8b23-ca8214f3fd44', '58151fb9-2912-42e3-b9be-aa046e9ae581', '1c7f6b56-cebe-4d09-8357-f5e49365dc07', '15151f95-d371-4485-9bf1-45d06c317fa8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:57 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:04:57 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:57 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:04:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Deleted volume successfully. Aug 26 03:04:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fa1f8eaf-2ee2-49d9-a2ed-30c584eeaab7 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-0271fc0c-2f06-44dd-8fde-282eaec382c1-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Flow 'volume_create_manager' (e2ee00d9-4396-48a2-8d45-1a348ae44ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419b9e9a-50b9-48af-9cbc-be740244b847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419b9e9a-50b9-48af-9cbc-be740244b847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-834995934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa13f02-2983-411a-88fe-5ff7d17fe1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d685b618f64aca93c2d373f41545c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:59Z,use_quota=True,user_id='1915c3fc4b1142e889e5d3e0570afc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f5e566-a180-48f9-b13d-0b95fb41c332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0f5e566-a180-48f9-b13d-0b95fb41c332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd6c296-8958-482a-bcf9-5789b5a65c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd6c296-8958-482a-bcf9-5789b5a65c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa13f02-2983-411a-88fe-5ff7d17fe1cd', 'volume_name': 'volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00393a02-15f0-4f31-8c99-c13be466ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00393a02-15f0-4f31-8c99-c13be466ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be12461-9a17-4c65-a420-5bf4f6524791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:04:59 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Volume daa13f02-2983-411a-88fe-5ff7d17fe1cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd', 'volume_size': 1} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-834995934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa13f02-2983-411a-88fe-5ff7d17fe1cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d685b618f64aca93c2d373f41545c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:04:59Z,use_quota=True,user_id='1915c3fc4b1142e889e5d3e0570afc74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Creating volume daa13f02-2983-411a-88fe-5ff7d17fe1cd {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:04:59 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:04:59 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd 1073741824 Aug 26 03:04:59 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:04:59 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Aug 26 03:04:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd 1073741824" returned: 0 in 0.658s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:00 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd Aug 26 03:05:00 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:00 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd" returned: 0 in 0.364s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be12461-9a17-4c65-a420-5bf4f6524791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b1fad4-85c8-4f55-b4e6-6f2d0ca0efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:00 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Volume volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd (daa13f02-2983-411a-88fe-5ff7d17fe1cd): created successfully Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5b1fad4-85c8-4f55-b4e6-6f2d0ca0efae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Flow 'volume_create_manager' (e2ee00d9-4396-48a2-8d45-1a348ae44ea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7eb3a71c-8093-4d9e-af7c-e235caf64f86 tempest-VolumesTransfersV357Test-1537695506 None] Created volume successfully. Aug 26 03:05:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Acquiring lock "cinder-daa13f02-2983-411a-88fe-5ff7d17fe1cd-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-daa13f02-2983-411a-88fe-5ff7d17fe1cd-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:01 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=111,cinder:SELECT=85,cinder:DELETE=11,cinder:INSERT=34 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=115,cinder:SELECT=99,cinder:INSERT=41,cinder:DELETE=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Acquiring lock "cinder-quobyte-daa13f02-2983-411a-88fe-5ff7d17fe1cd" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-quobyte-daa13f02-2983-411a-88fe-5ff7d17fe1cd" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5510f91f-2739-4e20-b03d-90b00c8d1170]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:02 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd Aug 26 03:05:02 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:02 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd" returned: 0 in 0.539s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:02 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd Aug 26 03:05:02 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:03 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-daa13f02-2983-411a-88fe-5ff7d17fe1cd" returned: 0 in 0.410s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-quobyte-daa13f02-2983-411a-88fe-5ff7d17fe1cd" released by "delete_volume" :: held 1.024s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Created reservations ['92124790-77d8-46ff-819e-3affb3661d3b', '9dde4820-7a9f-4478-afe2-fbb008b8c381', '8f95885d-13d9-4204-9cd9-b4984c9eec2c', '1c1a9eac-ac8f-4449-b74a-b69a29f542f0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:03 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:05:03 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:03 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Deleted volume successfully. Aug 26 03:05:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1a16e91b-f5cd-418e-8a81-a37484757e50 tempest-VolumesTransfersV357Test-1649019492 None] Lock "cinder-daa13f02-2983-411a-88fe-5ff7d17fe1cd-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (c2bd863a-de61-4b34-b47c-6febf745bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c074e948-1c7c-496d-b2c4-d001f45f1b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c074e948-1c7c-496d-b2c4-d001f45f1b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1906526908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34adf95-f25a-456f-b13d-577bbe18a733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:07Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d00172c-5bb2-406a-a91f-9c8cf9ed1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d00172c-5bb2-406a-a91f-9c8cf9ed1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78098bf1-09d1-42cc-96ed-fac63c005a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78098bf1-09d1-42cc-96ed-fac63c005a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34adf95-f25a-456f-b13d-577bbe18a733', 'volume_name': 'volume-b34adf95-f25a-456f-b13d-577bbe18a733', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570a816e-0602-4a41-9b81-bef910614b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (570a816e-0602-4a41-9b81-bef910614b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae218b58-243d-4a65-a1fa-0daa536899d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:07 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Volume b34adf95-f25a-456f-b13d-577bbe18a733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34adf95-f25a-456f-b13d-577bbe18a733', 'volume_size': 1} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1906526908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34adf95-f25a-456f-b13d-577bbe18a733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:07Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Creating volume b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:07 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:05:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:07 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 1073741824 Aug 26 03:05:07 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:08 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 1073741824" returned: 0 in 0.834s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:08 devstack sudo[104363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 Aug 26 03:05:08 devstack sudo[104363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:08 devstack sudo[104363]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae218b58-243d-4a65-a1fa-0daa536899d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34adf95-f25a-456f-b13d-577bbe18a733', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3e414a-c46b-48a6-9675-6b83613f2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:08 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Volume volume-b34adf95-f25a-456f-b13d-577bbe18a733 (b34adf95-f25a-456f-b13d-577bbe18a733): created successfully Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3e414a-c46b-48a6-9675-6b83613f2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (c2bd863a-de61-4b34-b47c-6febf745bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d01c6326-4a77-4fa2-9de1-3f5ac52f79ec tempest-VolumesSnapshotTestJSON-82279735 None] Created volume successfully. Aug 26 03:05:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Creating offline snapshot 2f925af6-3013-42f8-98cb-2eb875fd5497 of volume b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:05:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[86807fe2-8079-45ea-8248-1cdfbfb391d5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:10 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 Aug 26 03:05:10 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:10 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733" returned: 0 in 0.539s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:10 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 1G Aug 26 03:05:10 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:11 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 1G" returned: 0 in 0.723s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34adf95-f25a-456f-b13d-577bbe18a733 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:11 devstack sudo[104399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34adf95-f25a-456f-b13d-577bbe18a733 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 Aug 26 03:05:11 devstack sudo[104399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:11 devstack sudo[104399]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34adf95-f25a-456f-b13d-577bbe18a733 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497" returned: 0 in 0.624s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:11 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 is being set with open permissions: ugo+rw Aug 26 03:05:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:11 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 Aug 26 03:05:11 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:12 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497" returned: 0 in 0.453s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:12 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info Aug 26 03:05:12 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:12 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info" returned: 0 in 0.641s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:12 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info is being set with open permissions: ugo+rw Aug 26 03:05:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:13 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info Aug 26 03:05:13 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:13 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.info" returned: 0 in 0.522s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.694s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:13 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-10f8c80e-6b33-40b9-8e14-b44410c36f48 tempest-VolumesSnapshotTestJSON-82279735 None] Create snapshot completed successfully Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-2f925af6-3013-42f8-98cb-2eb875fd5497-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-2f925af6-3013-42f8-98cb-2eb875fd5497-delete_snapshot" acquired by "delete_snapshot" :: waited 0.095s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-b34adf95-f25a-456f-b13d-577bbe18a733" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b34adf95-f25a-456f-b13d-577bbe18a733" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-2f925af6-3013-42f8-98cb-2eb875fd5497" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2f925af6-3013-42f8-98cb-2eb875fd5497" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Deleting offline snapshot 2f925af6-3013-42f8-98cb-2eb875fd5497 of volume b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:05:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] snapshot_file for this snap is: volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:05:15 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[284f492b-1798-434b-8276-0000538314e9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:15 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 Aug 26 03:05:15 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:16 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497" returned: 0 in 1.054s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b34adf95-f25a-456f-b13d-577bbe18a733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:16 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdfa147-f69e-415b-8447-8bb122878ae7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:16 devstack sudo[104555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 Aug 26 03:05:16 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:16 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733" returned: 0 in 0.670s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:16 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 Aug 26 03:05:16 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:17 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497" returned: 0 in 0.750s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:17 devstack sudo[104589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497 Aug 26 03:05:17 devstack sudo[104589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:17 devstack sudo[104589]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733.2f925af6-3013-42f8-98cb-2eb875fd5497" returned: 0 in 0.384s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2f925af6-3013-42f8-98cb-2eb875fd5497" released by "_delete_snapshot" :: held 3.117s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b34adf95-f25a-456f-b13d-577bbe18a733" released by "delete_snapshot" :: held 3.166s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:18 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['65c48c8a-5032-48f4-9f65-69ae2d9f69ca', 'ec5c652f-a1f3-427a-85be-bca213cd6740', 'f732bbef-c261-4b28-a6dc-3625d5af0b49', 'c63ec9bd-8d2e-4ea9-bfb6-8247753fb63c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:18 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Delete snapshot completed successfully. Aug 26 03:05:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55a768f5-ea8c-404c-852b-097beec8fc0f tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-2f925af6-3013-42f8-98cb-2eb875fd5497-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (47c27130-809f-4c45-be99-fed0d4afbefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97a9644-a432-4349-b803-8159897b04a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97a9644-a432-4349-b803-8159897b04a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-336126047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77406cd-8c28-4241-927f-133ac2e2616d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:20Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236ddd35-b14f-44c2-98de-4b94815bbaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236ddd35-b14f-44c2-98de-4b94815bbaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76562372-9344-4836-a683-44f0fe5448d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76562372-9344-4836-a683-44f0fe5448d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77406cd-8c28-4241-927f-133ac2e2616d', 'volume_name': 'volume-b77406cd-8c28-4241-927f-133ac2e2616d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ac84da-7ce9-4bbb-97f3-24fc93a8a0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ac84da-7ce9-4bbb-97f3-24fc93a8a0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562bf9ae-954c-4d36-ad83-2dc386458e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Volume b77406cd-8c28-4241-927f-133ac2e2616d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77406cd-8c28-4241-927f-133ac2e2616d', 'volume_size': 1} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-336126047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77406cd-8c28-4241-927f-133ac2e2616d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:20Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Creating volume b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:20 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d 1073741824 Aug 26 03:05:20 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:20 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:05:20 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:20 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.475s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:05:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:05:21 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d 1073741824" returned: 0 in 1.020s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:21 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d Aug 26 03:05:21 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:21 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d" returned: 0 in 0.396s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562bf9ae-954c-4d36-ad83-2dc386458e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77406cd-8c28-4241-927f-133ac2e2616d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f44545-66bd-4b27-9aa6-b621632d899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Volume volume-b77406cd-8c28-4241-927f-133ac2e2616d (b77406cd-8c28-4241-927f-133ac2e2616d): created successfully Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f44545-66bd-4b27-9aa6-b621632d899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (47c27130-809f-4c45-be99-fed0d4afbefd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f047ecc7-092d-49b8-8441-73dfe416f935 tempest-VolumesSnapshotTestJSON-82279735 None] Created volume successfully. Aug 26 03:05:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Creating offline snapshot 2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 of volume b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:05:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b46008a-9b4c-42b6-b2e5-6711db5fc479]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:22 devstack sudo[104613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d Aug 26 03:05:22 devstack sudo[104613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:23 devstack sudo[104613]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d" returned: 0 in 1.305s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:23 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 1G Aug 26 03:05:23 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:25 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 1G" returned: 0 in 1.448s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77406cd-8c28-4241-927f-133ac2e2616d -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:25 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77406cd-8c28-4241-927f-133ac2e2616d -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 Aug 26 03:05:25 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:26 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77406cd-8c28-4241-927f-133ac2e2616d -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" returned: 0 in 1.049s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:26 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 is being set with open permissions: ugo+rw Aug 26 03:05:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:26 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 Aug 26 03:05:26 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:26 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" returned: 0 in 0.582s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:27 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info Aug 26 03:05:27 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:27 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info" returned: 0 in 0.431s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:27 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info is being set with open permissions: ugo+rw Aug 26 03:05:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:27 devstack sudo[104744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info Aug 26 03:05:27 devstack sudo[104744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:27 devstack sudo[104744]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.info" returned: 0 in 0.431s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.501s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a3a8f9c6-0cab-41b1-a625-ffebeeceaf56 tempest-VolumesSnapshotTestJSON-82279735 None] Create snapshot completed successfully Aug 26 03:05:31 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (f7958ee1-f527-4bcf-8039-d033dd94dbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68df0e1-174c-4633-91cd-c56d6e531c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68df0e1-174c-4633-91cd-c56d6e531c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1913206542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35672482-06e6-41d7-b1ac-108bb619f1ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2d07a78a-aa5b-421d-a0eb-d21d7fe79f37,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:32Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef272a84-ae00-4683-9c91-56679cdbb401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef272a84-ae00-4683-9c91-56679cdbb401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe73ab1-ac8a-48a5-b6ea-c2e6cea6504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe73ab1-ac8a-48a5-b6ea-c2e6cea6504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35672482-06e6-41d7-b1ac-108bb619f1ee', 'volume_name': 'volume-35672482-06e6-41d7-b1ac-108bb619f1ee', 'volume_size': 2, 'snapshot_id': '2d07a78a-aa5b-421d-a0eb-d21d7fe79f37'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1f1d40-93f5-4007-9dcf-8e92f43b4144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f1f1d40-93f5-4007-9dcf-8e92f43b4144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41af41fb-4804-4181-948d-ed3a956ce0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Volume 35672482-06e6-41d7-b1ac-108bb619f1ee: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35672482-06e6-41d7-b1ac-108bb619f1ee', 'volume_size': 2, 'snapshot_id': '2d07a78a-aa5b-421d-a0eb-d21d7fe79f37'} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37-35672482-06e6-41d7-b1ac-108bb619f1ee" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37-35672482-06e6-41d7-b1ac-108bb619f1ee" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Creating volume 35672482-06e6-41d7-b1ac-108bb619f1ee from snapshot 2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-35672482-06e6-41d7-b1ac-108bb619f1ee" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-35672482-06e6-41d7-b1ac-108bb619f1ee" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] snapshot: 2d07a78a-aa5b-421d-a0eb-d21d7fe79f37, volume: 35672482-06e6-41d7-b1ac-108bb619f1ee, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ffabb5-e96e-406f-8fe5-27c8f13e82c0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:32 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 Aug 26 03:05:32 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:33 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" returned: 0 in 1.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77406cd-8c28-4241-927f-133ac2e2616d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:33 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd94b25-4a9d-4e5a-952a-ee5dc04a0e85]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:34 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d Aug 26 03:05:34 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:34 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d" returned: 0 in 1.119s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:05:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:05:34 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:05:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:35 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee Aug 26 03:05:35 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:42 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=31,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:05:42 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=27,cinder:INSERT=7,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:05:45 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee" returned: 0 in 11.088s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d, size 1024.00 MB, duration 11.09 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:05:46 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Converted 1024.00 MB image at 92.33 MB/s Aug 26 03:05:46 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee is being set with open permissions: ugo+rw Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:46 devstack sudo[104894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee Aug 26 03:05:46 devstack sudo[104894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:46 devstack sudo[104894]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee" returned: 0 in 0.477s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-35672482-06e6-41d7-b1ac-108bb619f1ee" released by "_copy_volume_from_snapshot" :: held 14.147s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37-35672482-06e6-41d7-b1ac-108bb619f1ee" released by "_create_volume_from_snapshot" :: held 14.320s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.350s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41af41fb-4804-4181-948d-ed3a956ce0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35672482-06e6-41d7-b1ac-108bb619f1ee', 'volume_size': 2, 'snapshot_id': '2d07a78a-aa5b-421d-a0eb-d21d7fe79f37'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03d67e-d3e2-4926-8ad7-7d8f35e156f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Volume volume-35672482-06e6-41d7-b1ac-108bb619f1ee (35672482-06e6-41d7-b1ac-108bb619f1ee): created successfully Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c03d67e-d3e2-4926-8ad7-7d8f35e156f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (f7958ee1-f527-4bcf-8039-d033dd94dbe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3d01b94d-0df7-4508-8139-7b606cbfb058 tempest-VolumesSnapshotTestJSON-82279735 None] Created volume successfully. Aug 26 03:05:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-35672482-06e6-41d7-b1ac-108bb619f1ee-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-35672482-06e6-41d7-b1ac-108bb619f1ee-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-35672482-06e6-41d7-b1ac-108bb619f1ee" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-35672482-06e6-41d7-b1ac-108bb619f1ee" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:47 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a1cfa5-c1c8-4a63-ae53-761b91834ed9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:47 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee Aug 26 03:05:47 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:48 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee" returned: 0 in 0.769s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:48 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee Aug 26 03:05:48 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:48 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35672482-06e6-41d7-b1ac-108bb619f1ee" returned: 0 in 0.510s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-35672482-06e6-41d7-b1ac-108bb619f1ee" released by "delete_volume" :: held 1.365s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['673a9ead-0303-4f0d-b864-96fd3b78a711', 'ca8db45b-9c15-4fe9-bb00-6e923d5d117f', '749fe031-c813-4922-89fd-f420a1c042db', '3d812924-ba75-4789-a6af-f4de016c7de4'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:49 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:05:49 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:49 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.300s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Deleted volume successfully. Aug 26 03:05:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d0b159a2-fd7f-4e10-a26a-b33f39c51eab tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-35672482-06e6-41d7-b1ac-108bb619f1ee-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-b77406cd-8c28-4241-927f-133ac2e2616d" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b77406cd-8c28-4241-927f-133ac2e2616d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Deleting offline snapshot 2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 of volume b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] snapshot_file for this snap is: volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f0926b-cbfb-40c6-b72d-9c9b14f45582]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:50 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 Aug 26 03:05:50 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:50 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" returned: 0 in 0.463s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77406cd-8c28-4241-927f-133ac2e2616d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f60c9-eafd-492d-ab85-2047046b3dfa]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:50 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d Aug 26 03:05:50 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:51 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d" returned: 0 in 0.687s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:51 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 Aug 26 03:05:51 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:51 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" returned: 0 in 0.492s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:51 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37 Aug 26 03:05:51 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:52 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d.2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" returned: 0 in 0.313s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37" released by "_delete_snapshot" :: held 2.170s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b77406cd-8c28-4241-927f-133ac2e2616d" released by "delete_snapshot" :: held 2.230s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:52 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['28713763-f888-4df0-99bf-6bdcd4139abc', '38cf8385-d4eb-44ce-aafc-088fe19d5674', '02e53023-9505-4c8e-b66a-0dc1a6ad2fce', '6b6144cc-f8a3-49b9-8784-7aa3fee9ebd8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:52 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Delete snapshot completed successfully. Aug 26 03:05:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5904464c-1bd7-4a29-bf14-40d2879b09cf tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-2d07a78a-aa5b-421d-a0eb-d21d7fe79f37-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-b77406cd-8c28-4241-927f-133ac2e2616d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-b77406cd-8c28-4241-927f-133ac2e2616d-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-b77406cd-8c28-4241-927f-133ac2e2616d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:05:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b77406cd-8c28-4241-927f-133ac2e2616d" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:05:53 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09e8e32-ffc0-4392-bdd8-12e3a2d7f0e4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:05:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:54 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d Aug 26 03:05:54 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Flow 'volume_create_manager' (69f15d6f-e154-4d69-a40b-cdc606e37545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8294ef5d-f493-483e-8d99-c5c10fe408b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:54 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d" returned: 0 in 1.073s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8294ef5d-f493-483e-8d99-c5c10fe408b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-942779226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb285e52-45a8-4030-b4a9-917b1e15e1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c05750e6cfd47608e2f838c3f9d923a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:55Z,use_quota=True,user_id='8f645bc15d174d81add7cc11cbc4e584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074a890b-f206-4288-88b3-96a55de46a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:54 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d Aug 26 03:05:54 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074a890b-f206-4288-88b3-96a55de46a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018197b2-d93e-46e6-9ca5-896c6ce38f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (018197b2-d93e-46e6-9ca5-896c6ce38f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb285e52-45a8-4030-b4a9-917b1e15e1be', 'volume_name': 'volume-cb285e52-45a8-4030-b4a9-917b1e15e1be', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29697b-c4a4-44dd-b99d-3a827d29a20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff29697b-c4a4-44dd-b99d-3a827d29a20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34580119-2454-41bb-b80c-96696fe48568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Volume cb285e52-45a8-4030-b4a9-917b1e15e1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb285e52-45a8-4030-b4a9-917b1e15e1be', 'volume_size': 1} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-942779226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb285e52-45a8-4030-b4a9-917b1e15e1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c05750e6cfd47608e2f838c3f9d923a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:55Z,use_quota=True,user_id='8f645bc15d174d81add7cc11cbc4e584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Creating volume cb285e52-45a8-4030-b4a9-917b1e15e1be {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:55 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:55 devstack sudo[105027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be 1073741824 Aug 26 03:05:55 devstack sudo[105027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:55 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b77406cd-8c28-4241-927f-133ac2e2616d" returned: 0 in 0.437s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b77406cd-8c28-4241-927f-133ac2e2616d" released by "delete_volume" :: held 1.649s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['227d5bee-4669-4768-a912-8ed72f461f32', 'a8e52540-1e54-419f-9445-9893b3a8b577', 'f8cb1553-8c02-4f19-aa02-0cb3f940b590', '64c38700-3980-4773-be82-fa1f59511df5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:55 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:05:55 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:55 devstack sudo[105027]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be 1073741824" returned: 0 in 0.687s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:55 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be Aug 26 03:05:55 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:56 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.499s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:05:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Deleted volume successfully. Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0f471372-3234-4f14-bff2-e9099c277faa tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-b77406cd-8c28-4241-927f-133ac2e2616d-delete_volume" released by "delete_volume" :: held 2.649s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:05:56 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be" returned: 0 in 0.794s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34580119-2454-41bb-b80c-96696fe48568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb285e52-45a8-4030-b4a9-917b1e15e1be', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a01dcd-0b04-41b1-bcde-7e28bd3fff64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:56 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Volume volume-cb285e52-45a8-4030-b4a9-917b1e15e1be (cb285e52-45a8-4030-b4a9-917b1e15e1be): created successfully Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a01dcd-0b04-41b1-bcde-7e28bd3fff64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Flow 'volume_create_manager' (69f15d6f-e154-4d69-a40b-cdc606e37545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-36fa9e43-d5e0-403f-bc5c-b025341c5ad3 tempest-ServerRescueNegativeTestJSON-1228115923 None] Created volume successfully. Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (ee38fdc3-7f8d-4173-a377-57c8524c2c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bbaa91-28b5-4c6b-a8ac-dd02aa5ee08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bbaa91-28b5-4c6b-a8ac-dd02aa5ee08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1398965996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6523d639-8a4b-408d-8e5a-615720c9e124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:57Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f9e0c7-6e66-425a-b854-a61bd7234c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30f9e0c7-6e66-425a-b854-a61bd7234c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18af21f9-7b80-449d-9de0-75bc770e3c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18af21f9-7b80-449d-9de0-75bc770e3c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6523d639-8a4b-408d-8e5a-615720c9e124', 'volume_name': 'volume-6523d639-8a4b-408d-8e5a-615720c9e124', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3de252e-4a32-43f1-9735-cba2d9afe96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3de252e-4a32-43f1-9735-cba2d9afe96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96c9372-e152-4910-beff-79c37f92a10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:57 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Volume 6523d639-8a4b-408d-8e5a-615720c9e124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6523d639-8a4b-408d-8e5a-615720c9e124', 'volume_size': 1} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1398965996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6523d639-8a4b-408d-8e5a-615720c9e124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:05:57Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Creating volume 6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.082s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:05:57 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:05:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:57 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 1073741824 Aug 26 03:05:57 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:58 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 1073741824" returned: 0 in 1.103s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:05:59 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 Aug 26 03:05:59 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:05:59 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124" returned: 0 in 0.545s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96c9372-e152-4910-beff-79c37f92a10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6523d639-8a4b-408d-8e5a-615720c9e124', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c488152-1263-44c7-8d1b-639f20df6f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:05:59 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Volume volume-6523d639-8a4b-408d-8e5a-615720c9e124 (6523d639-8a4b-408d-8e5a-615720c9e124): created successfully Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c488152-1263-44c7-8d1b-639f20df6f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:05:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (ee38fdc3-7f8d-4173-a377-57c8524c2c93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:05:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-11976c99-86f5-4f24-86c0-d43d2bdab79c tempest-VolumesSnapshotTestJSON-82279735 None] Created volume successfully. Aug 26 03:06:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Creating offline snapshot 2ea6a4c6-913b-4558-9948-a59773529539 of volume 6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:06:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ee650-dc42-4ca2-9cfc-cc4516dc2ff4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:01 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 Aug 26 03:06:01 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:02 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124" returned: 0 in 0.876s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:02 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 1G Aug 26 03:06:02 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Flow 'volume_create_manager' (c8b6ed87-16be-4d37-8f29-7332dbbcd3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4699f324-011b-41f3-8cb4-34203b1f2705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4699f324-011b-41f3-8cb4-34203b1f2705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1058547129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e5ccbb-1507-4378-b127-3a89f0c88805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cbaba297c24f4db360d4ef3e89b25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:02Z,use_quota=True,user_id='bea0d21635214a318789e207b02687d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f6d097-618e-4359-b724-36c0507aa2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f6d097-618e-4359-b724-36c0507aa2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b51e064-9387-4f25-8e0a-706fcf2723e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b51e064-9387-4f25-8e0a-706fcf2723e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7e5ccbb-1507-4378-b127-3a89f0c88805', 'volume_name': 'volume-a7e5ccbb-1507-4378-b127-3a89f0c88805', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8eb40e-cb0d-4b2a-9867-da63d9a6ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8eb40e-cb0d-4b2a-9867-da63d9a6ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d466023-a6bc-49cb-b23b-e4dec00046fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:02 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Volume a7e5ccbb-1507-4378-b127-3a89f0c88805: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7e5ccbb-1507-4378-b127-3a89f0c88805', 'volume_size': 1} Aug 26 03:06:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:03 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 1G" returned: 0 in 1.228s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6523d639-8a4b-408d-8e5a-615720c9e124 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:03 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6523d639-8a4b-408d-8e5a-615720c9e124 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 Aug 26 03:06:03 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:04 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6523d639-8a4b-408d-8e5a-615720c9e124 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539" returned: 0 in 0.656s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:04 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 is being set with open permissions: ugo+rw Aug 26 03:06:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:04 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 Aug 26 03:06:04 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:04 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539" returned: 0 in 0.558s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:04 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info Aug 26 03:06:04 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:05 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info" returned: 0 in 0.606s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:05 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info is being set with open permissions: ugo+rw Aug 26 03:06:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:05 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info Aug 26 03:06:05 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:06 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.info" returned: 0 in 0.641s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.818s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.382s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1058547129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7e5ccbb-1507-4378-b127-3a89f0c88805,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91cbaba297c24f4db360d4ef3e89b25f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:02Z,use_quota=True,user_id='bea0d21635214a318789e207b02687d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Creating volume a7e5ccbb-1507-4378-b127-3a89f0c88805 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:06 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:06:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-95f2611b-c990-49a4-8e5c-36400a718547 tempest-VolumesSnapshotTestJSON-82279735 None] Create snapshot completed successfully Aug 26 03:06:06 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 1073741824 Aug 26 03:06:06 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:07 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 1073741824" returned: 0 in 1.093s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:07 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 Aug 26 03:06:07 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:08 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805" returned: 0 in 0.605s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d466023-a6bc-49cb-b23b-e4dec00046fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7e5ccbb-1507-4378-b127-3a89f0c88805', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e845303-f0a5-4831-86b8-1798aa94ed29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:08 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Volume volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 (a7e5ccbb-1507-4378-b127-3a89f0c88805): created successfully Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e845303-f0a5-4831-86b8-1798aa94ed29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Flow 'volume_create_manager' (c8b6ed87-16be-4d37-8f29-7332dbbcd3c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-81fe96a7-7d56-4491-82ca-59cd23377636 tempest-AttachVolumeNegativeTest-1708312843 None] Created volume successfully. Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (d275a6ff-0352-49d7-8283-e4833bd12e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08c9ead-e946-40d3-9845-e7a7acc400d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d08c9ead-e946-40d3-9845-e7a7acc400d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1865271357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b645d2-f9c0-457a-887e-bc49b15983e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb8e0e7ac54445a0a3da7d34aa634b74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ea6a4c6-913b-4558-9948-a59773529539,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:08Z,use_quota=True,user_id='b3b688d6d16f4af0bc628aa89c92cee9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa074921-886c-48b5-8abe-37394324dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa074921-886c-48b5-8abe-37394324dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83705bc-f00f-42e5-a248-014911358676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c83705bc-f00f-42e5-a248-014911358676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6b645d2-f9c0-457a-887e-bc49b15983e4', 'volume_name': 'volume-f6b645d2-f9c0-457a-887e-bc49b15983e4', 'volume_size': 1, 'snapshot_id': '2ea6a4c6-913b-4558-9948-a59773529539'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eaccd2a-9fc3-47b1-a440-652fb68d2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eaccd2a-9fc3-47b1-a440-652fb68d2896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb0f6c0-ec39-4414-a159-f17edc096445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:08 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Volume f6b645d2-f9c0-457a-887e-bc49b15983e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6b645d2-f9c0-457a-887e-bc49b15983e4', 'volume_size': 1, 'snapshot_id': '2ea6a4c6-913b-4558-9948-a59773529539'} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-2ea6a4c6-913b-4558-9948-a59773529539-f6b645d2-f9c0-457a-887e-bc49b15983e4" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2ea6a4c6-913b-4558-9948-a59773529539-f6b645d2-f9c0-457a-887e-bc49b15983e4" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Creating volume f6b645d2-f9c0-457a-887e-bc49b15983e4 from snapshot 2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-f6b645d2-f9c0-457a-887e-bc49b15983e4" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-f6b645d2-f9c0-457a-887e-bc49b15983e4" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] snapshot: 2ea6a4c6-913b-4558-9948-a59773529539, volume: f6b645d2-f9c0-457a-887e-bc49b15983e4, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c413e34-1232-4d69-9dba-916fb2cd2be6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:09 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 Aug 26 03:06:09 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:10 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539" returned: 0 in 1.147s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6523d639-8a4b-408d-8e5a-615720c9e124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[71124f27-e021-45a6-81b4-59f4d9c99302]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:10 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 Aug 26 03:06:10 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:11 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124" returned: 0 in 0.849s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:06:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:06:11 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:06:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:11 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 Aug 26 03:06:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e80d7c24-91c8-4467-84fb-756cfac57552 req-0c29216c-3580-4577-ac3d-eba6e3a16307 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:11 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Acquiring lock "cinder-cb285e52-45a8-4030-b4a9-917b1e15e1be-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "cinder-cb285e52-45a8-4030-b4a9-917b1e15e1be-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Acquiring lock "cinder-quobyte-cb285e52-45a8-4030-b4a9-917b1e15e1be" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "cinder-quobyte-cb285e52-45a8-4030-b4a9-917b1e15e1be" acquired by "delete_volume" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cc98e2-b99a-460d-b46e-3de9e8bcd4ff]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:20 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:20 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:20 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be Aug 26 03:06:20 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:20 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4" returned: 0 in 9.629s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124, size 1024.00 MB, duration 9.63 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:06:20 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Converted 1024.00 MB image at 106.31 MB/s Aug 26 03:06:20 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 is being set with open permissions: ugo+rw Aug 26 03:06:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:20 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 Aug 26 03:06:20 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:21 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.774s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:06:21 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be" returned: 0 in 0.974s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:21 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be Aug 26 03:06:21 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:21 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4" returned: 0 in 0.519s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-f6b645d2-f9c0-457a-887e-bc49b15983e4" released by "_copy_volume_from_snapshot" :: held 12.318s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2ea6a4c6-913b-4558-9948-a59773529539-f6b645d2-f9c0-457a-887e-bc49b15983e4" released by "_create_volume_from_snapshot" :: held 12.460s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.518s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e80d7c24-91c8-4467-84fb-756cfac57552 req-0c29216c-3580-4577-ac3d-eba6e3a16307 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.186s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-e80d7c24-91c8-4467-84fb-756cfac57552 req-0c29216c-3580-4577-ac3d-eba6e3a16307 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bb0f6c0-ec39-4414-a159-f17edc096445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b645d2-f9c0-457a-887e-bc49b15983e4', 'volume_size': 1, 'snapshot_id': '2ea6a4c6-913b-4558-9948-a59773529539'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf973b6-d029-4c04-b59e-b09934ff072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Volume volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 (f6b645d2-f9c0-457a-887e-bc49b15983e4): created successfully Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf973b6-d029-4c04-b59e-b09934ff072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:21 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Flow 'volume_create_manager' (d275a6ff-0352-49d7-8283-e4833bd12e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-e80d7c24-91c8-4467-84fb-756cfac57552 req-0c29216c-3580-4577-ac3d-eba6e3a16307 tempest-AttachVolumeNegativeTest-1708312843 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-a7e5ccbb-1507-4378-b127-3a89f0c88805', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c88abfd4-8697-4b47-af29-9f776f79404c', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cb285e52-45a8-4030-b4a9-917b1e15e1be" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "cinder-quobyte-cb285e52-45a8-4030-b4a9-917b1e15e1be" released by "delete_volume" :: held 1.443s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6ba802eb-6531-4b28-aafa-e3b48ab9867d tempest-VolumesSnapshotTestJSON-82279735 None] Created volume successfully. Aug 26 03:06:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-e80d7c24-91c8-4467-84fb-756cfac57552 req-0c29216c-3580-4577-ac3d-eba6e3a16307 tempest-AttachVolumeNegativeTest-1708312843 None] attachment_update completed successfully. Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Created reservations ['5fbe2a79-0438-4718-83ae-0c05d2f957f5', '38168dda-be25-4737-a95d-46989563eb30', '1860ae2b-5f96-4464-9dc2-b8560b0d590f', 'dd49057b-6f5b-4a5b-a057-4adcb65de595'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:21 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:21 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Flow 'volume_create_manager' (911e76d0-f6f3-4d10-b903-b0d78c81fa86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5049628-593d-4c67-8832-9c882c5b678f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-f6b645d2-f9c0-457a-887e-bc49b15983e4-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5049628-593d-4c67-8832-9c882c5b678f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-510299651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c990993e-b6bd-4bbd-9d7c-c30e9bfb964e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aefb44c7f9e4efaa1e84f8841feaf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:22Z,use_quota=True,user_id='db045f46a2964c0e9be7cf541331e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e7fd92-fd6c-4ea6-a8a9-8d180b5a52d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e7fd92-fd6c-4ea6-a8a9-8d180b5a52d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41c8474-5185-4b0d-ad63-04cb531166ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-f6b645d2-f9c0-457a-887e-bc49b15983e4-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-f6b645d2-f9c0-457a-887e-bc49b15983e4" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-f6b645d2-f9c0-457a-887e-bc49b15983e4" acquired by "delete_volume" :: waited 0.046s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c86fdd1-3c31-4c16-a28f-509a782c766e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:22 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.622s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Deleted volume successfully. Aug 26 03:06:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-643d2879-bc65-4013-9ea1-739a397286f7 tempest-ServerRescueNegativeTestJSON-1228115923 None] Lock "cinder-cb285e52-45a8-4030-b4a9-917b1e15e1be-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:22 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 Aug 26 03:06:22 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:23 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4" returned: 0 in 0.677s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:23 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4 Aug 26 03:06:23 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41c8474-5185-4b0d-ad63-04cb531166ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c990993e-b6bd-4bbd-9d7c-c30e9bfb964e', 'volume_name': 'volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c388971-7ef9-497a-a4b8-af8eeeb69bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c388971-7ef9-497a-a4b8-af8eeeb69bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7269a3-fd74-4c8a-a6d3-977273846185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:23 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Volume c990993e-b6bd-4bbd-9d7c-c30e9bfb964e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Trying to clone c990993e-b6bd-4bbd-9d7c-c30e9bfb964e from image c93cc321-597b-4580-96b0-992799bdc1cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:06:23 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f6b645d2-f9c0-457a-887e-bc49b15983e4" returned: 0 in 0.473s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-f6b645d2-f9c0-457a-887e-bc49b15983e4" released by "delete_volume" :: held 1.278s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['1296f152-ea19-41a4-9255-4a13a3dced4b', '0ceceda6-8ce0-426b-8421-779f3a9ac421', 'c03fdb58-a87b-4411-805c-5d2b97d40afb', 'a254a261-66be-4451-afee-98c442e56fc6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:06:24 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:24 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:24 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8a1e2-5ccb-446a-b95b-666a3080319a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:24 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD Aug 26 03:06:24 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-2ea6a4c6-913b-4558-9948-a59773529539-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-2ea6a4c6-913b-4558-9948-a59773529539-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-6523d639-8a4b-408d-8e5a-615720c9e124" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-6523d639-8a4b-408d-8e5a-615720c9e124" acquired by "delete_snapshot" :: waited 0.062s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-2ea6a4c6-913b-4558-9948-a59773529539" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2ea6a4c6-913b-4558-9948-a59773529539" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Deleting offline snapshot 2ea6a4c6-913b-4558-9948-a59773529539 of volume 6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:06:24 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] snapshot_file for this snap is: volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.724s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Deleted volume successfully. Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4342bb3-7aac-471f-b26f-d28dd7d88489]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:25 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD" returned: 0 in 0.732s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf is fetched for user db045f46a2964c0e9be7cf541331e33f. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c375536-9ff1-49ea-be29-d291f798ec54 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-f6b645d2-f9c0-457a-887e-bc49b15983e4-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bbc940-f4da-40cb-b0f6-96fcaa1c66ce]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:25 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD Aug 26 03:06:25 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:25 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 Aug 26 03:06:25 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:25 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD" returned: 0 in 0.628s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-510299651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c990993e-b6bd-4bbd-9d7c-c30e9bfb964e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aefb44c7f9e4efaa1e84f8841feaf1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:06:22Z,use_quota=True,user_id='db045f46a2964c0e9be7cf541331e33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Creating volume c990993e-b6bd-4bbd-9d7c-c30e9bfb964e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:06:25 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:06:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:26 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e 1073741824 Aug 26 03:06:26 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:26 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539" returned: 0 in 1.030s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6523d639-8a4b-408d-8e5a-615720c9e124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d2df12-e672-4319-9420-1198709e4043]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-5ad6c1dc-a641-4c24-8570-2666a1a720ca req-fb7bbad9-b340-4890-9582-4a46e3548084 tempest-AttachVolumeNegativeTest-1708312843 None] Terminate volume connection completed successfully. Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-5ad6c1dc-a641-4c24-8570-2666a1a720ca req-fb7bbad9-b340-4890-9582-4a46e3548084 tempest-AttachVolumeNegativeTest-1708312843 None] Deleting attachment c88abfd4-8697-4b47-af29-9f776f79404c. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:06:26 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 Aug 26 03:06:26 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:26 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e 1073741824" returned: 0 in 0.935s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:26 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e Aug 26 03:06:26 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:27 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124" returned: 0 in 0.877s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:27 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 Aug 26 03:06:27 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:27 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Attempting download of c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume c990993e-b6bd-4bbd-9d7c-c30e9bfb964e. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78c625a-0f3b-4a51-86f3-6cf6c045e1e4]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:27 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca Aug 26 03:06:27 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:27 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539" returned: 0 in 0.456s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:27 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539 Aug 26 03:06:27 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:27 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca" returned: 0 in 0.517s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:27 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca Aug 26 03:06:27 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:28 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124.2ea6a4c6-913b-4558-9948-a59773529539" returned: 0 in 0.523s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-2ea6a4c6-913b-4558-9948-a59773529539" released by "_delete_snapshot" :: held 3.121s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-6523d639-8a4b-408d-8e5a-615720c9e124" released by "delete_snapshot" :: held 3.188s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['70901e26-8f05-42b8-bdc2-e9562af75a4a', 'ce0d2bde-6d20-4e2d-9093-c70f71633d1d', '800d0077-5f97-4a34-99e3-0237175bc644', '6ba0e712-e762-437f-a0e3-8d4a66da0274'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Delete snapshot completed successfully. Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-82fd9b65-a4fd-460d-8bf6-7553a18540fe tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-2ea6a4c6-913b-4558-9948-a59773529539-delete_snapshot" released by "delete_snapshot" :: held 3.650s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:28 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca" returned: 1 in 0.718s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_dfpuudca' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7c4f10-3a27-42ad-bfc3-45d21dda6bd8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:28 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD Aug 26 03:06:28 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:29 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] c93cc321-597b-4580-96b0-992799bdc1cf was qcow2, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-6523d639-8a4b-408d-8e5a-615720c9e124-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:29 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e Aug 26 03:06:29 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-6523d639-8a4b-408d-8e5a-615720c9e124-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-6523d639-8a4b-408d-8e5a-615720c9e124" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-6523d639-8a4b-408d-8e5a-615720c9e124" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fad4afc-c6cc-4a79-93fa-88432c716617]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:29 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 Aug 26 03:06:29 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:30 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124" returned: 0 in 0.539s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:30 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124 Aug 26 03:06:30 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:30 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6523d639-8a4b-408d-8e5a-615720c9e124" returned: 0 in 0.402s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-6523d639-8a4b-408d-8e5a-615720c9e124" released by "delete_volume" :: held 1.096s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['2ae2d36e-bcdc-4d0e-bd0a-16d602277f3f', 'c7a8c97f-6234-4a7e-a495-04fb634e6573', 'ebef2ec3-aaee-46c2-842e-ea897abbe7ff', '2d256f6d-cd82-4f8a-aa7f-9d4dbf8ea3ac'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:30 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:30 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:31 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.352s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:31 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Deleted volume successfully. Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4619f1bd-3706-4acc-b077-e70dff3b8c33 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-6523d639-8a4b-408d-8e5a-615720c9e124-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-b34adf95-f25a-456f-b13d-577bbe18a733-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-b34adf95-f25a-456f-b13d-577bbe18a733-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "cinder-quobyte-b34adf95-f25a-456f-b13d-577bbe18a733" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b34adf95-f25a-456f-b13d-577bbe18a733" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c4b8b5-51a0-4a63-8c3d-8ff12e4ae687]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:32 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" returned: 0 in 2.724s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_bz0_38k0devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:06:32 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Converted 112.00 MB image at 41.06 MB/s Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:32 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e 1G Aug 26 03:06:32 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:32 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 Aug 26 03:06:32 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:32 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e 1G" returned: 0 in 0.566s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Downloaded image c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume c990993e-b6bd-4bbd-9d7c-c30e9bfb964e successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf for user db045f46a2964c0e9be7cf541331e33f is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Marking volume c990993e-b6bd-4bbd-9d7c-c30e9bfb964e as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Copying metadata from image c93cc321-597b-4580-96b0-992799bdc1cf to c990993e-b6bd-4bbd-9d7c-c30e9bfb964e. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Creating volume glance metadata for volume c990993e-b6bd-4bbd-9d7c-c30e9bfb964e backed by image c93cc321-597b-4580-96b0-992799bdc1cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:06:32 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733" returned: 0 in 0.753s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:32 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733 Aug 26 03:06:32 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca7269a3-fd74-4c8a-a6d3-977273846185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee51e16c-5054-4383-a94d-8a3dc147261d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:06:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Volume volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e (c990993e-b6bd-4bbd-9d7c-c30e9bfb964e): created successfully Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee51e16c-5054-4383-a94d-8a3dc147261d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:06:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Flow 'volume_create_manager' (911e76d0-f6f3-4d10-b903-b0d78c81fa86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:06:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0ba7d7df-e682-4353-80dc-19c546dbdfc4 tempest-TestShelveInstance-877367132 None] Created volume successfully. Aug 26 03:06:33 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b34adf95-f25a-456f-b13d-577bbe18a733" returned: 0 in 0.330s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-quobyte-b34adf95-f25a-456f-b13d-577bbe18a733" released by "delete_volume" :: held 1.168s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Created reservations ['7bddcc78-ca63-4c55-8f3b-322bb613b36b', 'f7e54e3c-e364-4704-a842-42b3cd601655', '517e7709-a59b-42bf-85cd-5683e12b1ab3', '9707f3c9-1701-4e94-8c7a-b9b220e01ef6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:33 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:33 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:33 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.308s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Deleted volume successfully. Aug 26 03:06:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b53481d0-c441-486b-aa55-b6e4e1b6ea22 tempest-VolumesSnapshotTestJSON-82279735 None] Lock "cinder-b34adf95-f25a-456f-b13d-577bbe18a733-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "cinder-a7e5ccbb-1507-4378-b127-3a89f0c88805-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-a7e5ccbb-1507-4378-b127-3a89f0c88805-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "cinder-quobyte-a7e5ccbb-1507-4378-b127-3a89f0c88805" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-quobyte-a7e5ccbb-1507-4378-b127-3a89f0c88805" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd4226-8866-4e9e-920f-3255d8f4497d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:36 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 Aug 26 03:06:36 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:37 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805" returned: 0 in 0.507s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:37 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805 Aug 26 03:06:37 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:37 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7e5ccbb-1507-4378-b127-3a89f0c88805" returned: 0 in 0.333s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-quobyte-a7e5ccbb-1507-4378-b127-3a89f0c88805" released by "delete_volume" :: held 0.899s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Created reservations ['be053421-c531-4175-b3f6-da87076d4664', '0db6434b-cecd-4200-90fb-63972694b2b4', '9e113b4b-e3a7-4a4c-9fb1-a1fdd1d24fa4', '66685809-328f-4c00-8f67-90ad2bec4cad'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:37 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:37 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:38 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.338s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:38 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Deleted volume successfully. Aug 26 03:06:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b352975c-b845-47ec-baa8-c3ce806ee5e5 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-a7e5ccbb-1507-4378-b127-3a89f0c88805-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "cinder-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "cinder-quobyte-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-quobyte-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce5537-3d13-4535-8e0c-238b5606c39a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:39 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b Aug 26 03:06:39 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:39 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b" returned: 0 in 0.616s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:39 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b Aug 26 03:06:39 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-77f37343-18d7-4e58-a326-11baefc44337 req-e479b60a-62d5-4f30-9584-434eebfb7c81 tempest-TestShelveInstance-877367132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-77f37343-18d7-4e58-a326-11baefc44337 req-e479b60a-62d5-4f30-9584-434eebfb7c81 tempest-TestShelveInstance-877367132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-77f37343-18d7-4e58-a326-11baefc44337 req-e479b60a-62d5-4f30-9584-434eebfb7c81 tempest-TestShelveInstance-877367132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-77f37343-18d7-4e58-a326-11baefc44337 req-e479b60a-62d5-4f30-9584-434eebfb7c81 tempest-TestShelveInstance-877367132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86ddc127-59c1-4382-a097-2012b28a75a2', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:06:40 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b" returned: 0 in 0.341s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-quobyte-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b" released by "delete_volume" :: held 1.042s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-77f37343-18d7-4e58-a326-11baefc44337 req-e479b60a-62d5-4f30-9584-434eebfb7c81 tempest-TestShelveInstance-877367132 None] attachment_update completed successfully. Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Created reservations ['c9989fb2-476e-4240-86ce-99d7710e3180', 'af0949c8-fdce-475e-b32c-50ffa4479551', 'df29e7be-e1f1-41f0-9d49-34200dd22dde', 'dc64baaf-43c7-46bd-873c-c37f85fbff69'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:40 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:40 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:40 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Deleted volume successfully. Aug 26 03:06:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-de09b7c5-def3-48a9-92f0-2af5e09782f4 tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-b2783cae-c79b-4dd4-a1d1-5fa6917feb7b-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "cinder-4359b879-0c90-45f3-a3c7-8dd260ccf9b7-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-4359b879-0c90-45f3-a3c7-8dd260ccf9b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "cinder-quobyte-4359b879-0c90-45f3-a3c7-8dd260ccf9b7" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:06:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-quobyte-4359b879-0c90-45f3-a3c7-8dd260ccf9b7" acquired by "delete_volume" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:06:41 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc3c9b5-2573-441b-8969-8e0ca73e5d47]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:06:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:42 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 Aug 26 03:06:42 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:42 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:42 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7 Aug 26 03:06:42 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:42 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4359b879-0c90-45f3-a3c7-8dd260ccf9b7" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-quobyte-4359b879-0c90-45f3-a3c7-8dd260ccf9b7" released by "delete_volume" :: held 1.068s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:42 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=83,cinder:UPDATE=101,cinder:INSERT=34,cinder:DELETE=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=100,cinder:UPDATE=98,cinder:INSERT=26,cinder:DELETE=7 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Created reservations ['a0e948bd-9af8-419d-942d-a30f4571f58f', '839dba4b-9584-4b90-b079-0c8467f636af', 'a67b651b-bf46-460a-869d-892d4a6fe50c', '8b4e8466-df44-4e02-a638-d01586565260'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:06:43 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:06:43 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:06:43 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.311s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:06:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Deleted volume successfully. Aug 26 03:06:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3df948fc-415b-42ef-b634-a1ace726943d tempest-AttachVolumeNegativeTest-1708312843 None] Lock "cinder-4359b879-0c90-45f3-a3c7-8dd260ccf9b7-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:06:53 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:INSERT=3,cinder:UPDATE=6,cinder:SELECT=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:06:53 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Flow 'volume_create_manager' (a00fe43a-3e17-4518-80ec-c257f7188cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b25c2a-9eb5-4329-b9e6-1b6ac6dd054c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46b25c2a-9eb5-4329-b9e6-1b6ac6dd054c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1578087520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a0b78-de5e-4343-9c53-84a0440c75fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e4e0712c9f4c2a87a5e54de4986612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:06Z,use_quota=True,user_id='be872d40415946c796759054a64b8fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419e8ff2-4a3f-4a9b-bb50-eb5d70fef135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419e8ff2-4a3f-4a9b-bb50-eb5d70fef135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb4f00e-71f6-403e-98bb-f6ba6be679ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb4f00e-71f6-403e-98bb-f6ba6be679ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '412a0b78-de5e-4343-9c53-84a0440c75fa', 'volume_name': 'volume-412a0b78-de5e-4343-9c53-84a0440c75fa', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc7d26-612b-40b0-9d44-3358366711d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78cc7d26-612b-40b0-9d44-3358366711d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3a2cce-ff30-4384-9c61-aca948da1b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:06 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Volume 412a0b78-de5e-4343-9c53-84a0440c75fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-412a0b78-de5e-4343-9c53-84a0440c75fa', 'volume_size': 1} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1578087520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=412a0b78-de5e-4343-9c53-84a0440c75fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='63e4e0712c9f4c2a87a5e54de4986612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:06Z,use_quota=True,user_id='be872d40415946c796759054a64b8fb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Creating volume 412a0b78-de5e-4343-9c53-84a0440c75fa {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:06 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:07:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:06 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa 1073741824 Aug 26 03:07:06 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:07 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa 1073741824" returned: 0 in 0.760s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:07 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa Aug 26 03:07:07 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:07 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa" returned: 0 in 0.414s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] <== create_volume: return (1258ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c3a2cce-ff30-4384-9c61-aca948da1b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-412a0b78-de5e-4343-9c53-84a0440c75fa', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a822abf-a99c-4da8-ab1f-4931d716025b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:07 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Volume volume-412a0b78-de5e-4343-9c53-84a0440c75fa (412a0b78-de5e-4343-9c53-84a0440c75fa): created successfully Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a822abf-a99c-4da8-ab1f-4931d716025b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Flow 'volume_create_manager' (a00fe43a-3e17-4518-80ec-c257f7188cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-f7be92f2-6f6f-4fac-a1fc-857b867bdb41 req-c0fe6e42-2e8b-46b0-a1c6-4faabdc5b5e8 tempest-VolumesGetTestJSON-1851824204 None] Created volume successfully. Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Acquiring lock "cinder-412a0b78-de5e-4343-9c53-84a0440c75fa-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Lock "cinder-412a0b78-de5e-4343-9c53-84a0440c75fa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Acquiring lock "cinder-quobyte-412a0b78-de5e-4343-9c53-84a0440c75fa" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Lock "cinder-quobyte-412a0b78-de5e-4343-9c53-84a0440c75fa" acquired by "delete_volume" :: waited 0.044s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f7b8e6-8d50-4847-b91d-f3df6b727cc1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:09 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa Aug 26 03:07:09 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:09 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa" returned: 0 in 0.671s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:10 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa Aug 26 03:07:10 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:10 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-412a0b78-de5e-4343-9c53-84a0440c75fa" returned: 0 in 0.426s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Lock "cinder-quobyte-412a0b78-de5e-4343-9c53-84a0440c75fa" released by "delete_volume" :: held 1.190s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG cinder.quota [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Created reservations ['48d017f3-700c-46b0-95c0-6f0407886b65', '85067ce1-9e06-4dd5-b5b2-3918738be7ea', 'e75e807f-e419-4642-99b5-6d03f2bbe3cf', '6154c19e-bc76-4ea9-a790-36cfcea028b9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:10 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:07:10 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:11 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:11 devstack cinder-volume[94506]: DEBUG cinder.manager [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Deleted volume successfully. Aug 26 03:07:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-76e20794-25d6-4fa3-8795-510e9fc94b7d req-bdaac7cf-2d43-4347-a881-1703bd958d38 tempest-VolumesGetTestJSON-1851824204 None] Lock "cinder-412a0b78-de5e-4343-9c53-84a0440c75fa-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:20 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:07:20 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:07:20 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.711s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:07:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:07:21 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=15,cinder:DELETE=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:07:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9a2513b4-9f93-426b-b3f0-9caf13b35d09 tempest-GroupsTest-1253881912 None] Group tempest-Group1-1881119310: creating Aug 26 03:07:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9a2513b4-9f93-426b-b3f0-9caf13b35d09 tempest-GroupsTest-1253881912 None] Group tempest-Group1-1881119310: created successfully Aug 26 03:07:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9a2513b4-9f93-426b-b3f0-9caf13b35d09 tempest-GroupsTest-1253881912 None] Create group completed successfully. Aug 26 03:07:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4ad32c9d-6a04-4d52-bca7-06eb52f2cc73 tempest-GroupsTest-1253881912 None] Group tempest-Group2-897434814: creating Aug 26 03:07:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4ad32c9d-6a04-4d52-bca7-06eb52f2cc73 tempest-GroupsTest-1253881912 None] Group tempest-Group2-897434814: created successfully Aug 26 03:07:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4ad32c9d-6a04-4d52-bca7-06eb52f2cc73 tempest-GroupsTest-1253881912 None] Create group completed successfully. Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Flow 'volume_create_manager' (90d2471f-8ce4-4f1d-b946-dd6d295b9902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa1e978-a5c9-47c6-8795-2f67b3a9180d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aa1e978-a5c9-47c6-8795-2f67b3a9180d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1789780043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54c293f3-4827-44ac-affc-3dabb4d59a8c,host='devstack@QuobyteHD#QuobyteHD',id=6c0ebff4-059f-4aa6-9433-7d006b9f23eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c92ee83e58e4be5b679614c910d8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:34Z,use_quota=True,user_id='49727133b8a94884b52d442f687c5f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4664282a-e657-44dd-aefc-0ff6d4b60626),volume_type_id=4664282a-e657-44dd-aefc-0ff6d4b60626)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf5e9d7-5f1d-4f21-b871-9100a75da84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf5e9d7-5f1d-4f21-b871-9100a75da84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb37b7b-88e7-4905-bd56-d40398b9ff43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb37b7b-88e7-4905-bd56-d40398b9ff43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0ebff4-059f-4aa6-9433-7d006b9f23eb', 'volume_name': 'volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aa959c-4715-4afb-9a03-678531fb4f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81aa959c-4715-4afb-9a03-678531fb4f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0cb75-8af8-4aee-b8ad-2d9e749e7af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:34 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Volume 6c0ebff4-059f-4aa6-9433-7d006b9f23eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb', 'volume_size': 1} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54c293f3-4827-44ac-affc-3dabb4d59a8c,created_at=2026-08-26T01:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1789780043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54c293f3-4827-44ac-affc-3dabb4d59a8c,host='devstack@QuobyteHD#QuobyteHD',id=6c0ebff4-059f-4aa6-9433-7d006b9f23eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c92ee83e58e4be5b679614c910d8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:34Z,use_quota=True,user_id='49727133b8a94884b52d442f687c5f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4664282a-e657-44dd-aefc-0ff6d4b60626),volume_type_id=4664282a-e657-44dd-aefc-0ff6d4b60626)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Creating volume 6c0ebff4-059f-4aa6-9433-7d006b9f23eb {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:35 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:07:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:35 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb 1073741824 Aug 26 03:07:35 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-31a4e5c0-6409-43ef-b5bc-a8b4975c4046 req-0787fbea-c3ac-46ed-b0bf-ca42581148db tempest-TestShelveInstance-877367132 None] Terminate volume connection completed successfully. Aug 26 03:07:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-31a4e5c0-6409-43ef-b5bc-a8b4975c4046 req-0787fbea-c3ac-46ed-b0bf-ca42581148db tempest-TestShelveInstance-877367132 None] Deleting attachment 86ddc127-59c1-4382-a097-2012b28a75a2. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:07:36 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb 1073741824" returned: 0 in 1.267s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:36 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb Aug 26 03:07:36 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:36 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb" returned: 0 in 0.570s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0cb75-8af8-4aee-b8ad-2d9e749e7af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252913ae-7ebf-473e-8d5f-ea3222f66415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Volume volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb (6c0ebff4-059f-4aa6-9433-7d006b9f23eb): created successfully Aug 26 03:07:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (252913ae-7ebf-473e-8d5f-ea3222f66415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Flow 'volume_create_manager' (90d2471f-8ce4-4f1d-b946-dd6d295b9902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-af375420-26f1-405c-9a96-d5829170518a tempest-GroupsTest-1253881912 None] Created volume successfully. Aug 26 03:07:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Acquiring lock "cinder-quobyte-6c0ebff4-059f-4aa6-9433-7d006b9f23eb" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Lock "cinder-quobyte-6c0ebff4-059f-4aa6-9433-7d006b9f23eb" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e72b08c-d972-4b5c-8480-35e70a976e4b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:38 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb Aug 26 03:07:38 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:39 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb" returned: 0 in 0.569s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:39 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb Aug 26 03:07:39 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:39 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6c0ebff4-059f-4aa6-9433-7d006b9f23eb" returned: 0 in 0.682s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Lock "cinder-quobyte-6c0ebff4-059f-4aa6-9433-7d006b9f23eb" released by "delete_volume" :: held 1.321s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Created reservations ['e77615dd-460d-47b6-a302-38e116cdc0ec'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:40 devstack cinder-volume[94506]: WARNING cinder.quota [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-391257872 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-391257872, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:07:40 devstack cinder-volume[94506]: WARNING cinder.quota [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-391257872 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-391257872, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Created reservations ['ac7fce76-e073-427a-811e-0187bec1d75e', '7c6f12b7-7301-41f4-9ea3-e645f44be641', '1c56d78c-e9c8-4754-91e8-4d3d9583d68d', 'ed9d6ff1-71be-4656-8b1e-fd8a32308be6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:40 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:07:40 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b7b6c9fd-5059-47e5-887a-918b6eb925c9 req-99f323eb-65c4-49f0-b954-a46b5484605d tempest-TestShelveInstance-877367132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b7b6c9fd-5059-47e5-887a-918b6eb925c9 req-99f323eb-65c4-49f0-b954-a46b5484605d tempest-TestShelveInstance-877367132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b7b6c9fd-5059-47e5-887a-918b6eb925c9 req-99f323eb-65c4-49f0-b954-a46b5484605d tempest-TestShelveInstance-877367132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-b7b6c9fd-5059-47e5-887a-918b6eb925c9 req-99f323eb-65c4-49f0-b954-a46b5484605d tempest-TestShelveInstance-877367132 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3592f967-3f79-4e2b-8507-5663364ccf55', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:07:41 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.473s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b36b0c65-300a-442a-bcdd-5fb38c01aaf5 tempest-GroupsTest-1253881912 None] Delete group completed successfully. Aug 26 03:07:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-b7b6c9fd-5059-47e5-887a-918b6eb925c9 req-99f323eb-65c4-49f0-b954-a46b5484605d tempest-TestShelveInstance-877367132 None] attachment_update completed successfully. Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Created reservations ['744dc412-cf4f-47c5-a197-38c8fbcb210f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:41 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:07:41 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:41 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.290s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:41 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:07:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d2dcdb09-a75f-4c3d-a613-027ef12d83c9 tempest-GroupsTest-1253881912 None] Delete group completed successfully. Aug 26 03:07:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9b9673bc-5ea8-43a4-8748-48dd6db00a5c tempest-GroupsTest-1253881912 None] Group tempest-GroupsTest-Group-1930324132: creating Aug 26 03:07:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9b9673bc-5ea8-43a4-8748-48dd6db00a5c tempest-GroupsTest-1253881912 None] Group tempest-GroupsTest-Group-1930324132: created successfully Aug 26 03:07:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9b9673bc-5ea8-43a4-8748-48dd6db00a5c tempest-GroupsTest-1253881912 None] Create group completed successfully. Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Flow 'volume_create_manager' (28aaa4e6-54fa-4369-8f68-3199865ce399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18fc27a-dac2-4ca5-91df-2233c53916c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18fc27a-dac2-4ca5-91df-2233c53916c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505835787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaa6729a-ea5d-4976-afd0-33aeb7c5b219,host='devstack@QuobyteHD#QuobyteHD',id=46bb4dd9-74f6-4fde-9d79-fd238633a1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c92ee83e58e4be5b679614c910d8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:46Z,use_quota=True,user_id='49727133b8a94884b52d442f687c5f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8),volume_type_id=c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0204b902-4ee7-47bc-9e44-dff41c501e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0204b902-4ee7-47bc-9e44-dff41c501e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6852d466-6acc-45ea-b444-4f8bb781fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6852d466-6acc-45ea-b444-4f8bb781fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46bb4dd9-74f6-4fde-9d79-fd238633a1eb', 'volume_name': 'volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3dfe3c-8046-4dc1-9dd2-aedc464d9b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3dfe3c-8046-4dc1-9dd2-aedc464d9b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263dd489-749f-407d-bbdc-ee9084f309a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Volume 46bb4dd9-74f6-4fde-9d79-fd238633a1eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb', 'volume_size': 1} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eaa6729a-ea5d-4976-afd0-33aeb7c5b219,created_at=2026-08-26T01:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-505835787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaa6729a-ea5d-4976-afd0-33aeb7c5b219,host='devstack@QuobyteHD#QuobyteHD',id=46bb4dd9-74f6-4fde-9d79-fd238633a1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c92ee83e58e4be5b679614c910d8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:46Z,use_quota=True,user_id='49727133b8a94884b52d442f687c5f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8),volume_type_id=c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Creating volume 46bb4dd9-74f6-4fde-9d79-fd238633a1eb {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:46 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:07:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:46 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb 1073741824 Aug 26 03:07:46 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:48 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb 1073741824" returned: 0 in 1.489s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Flow 'volume_create_manager' (7e34e2c7-5f1e-405d-98a6-ab7ec48182f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6b2515-c7c9-4a9e-8f48-80fb9eabee64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c6b2515-c7c9-4a9e-8f48-80fb9eabee64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-270934533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabc3919-1f98-4236-97ab-9c0ade34b137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da78241572594c98ad8e5d02631c1e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:48Z,use_quota=True,user_id='c7416a13fedf4c458798b402b060821f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4697bd64-10f8-46d1-9afb-adcb5280ae7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4697bd64-10f8-46d1-9afb-adcb5280ae7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9138aa7b-0ccf-40e3-b1e3-3e7120903168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9138aa7b-0ccf-40e3-b1e3-3e7120903168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabc3919-1f98-4236-97ab-9c0ade34b137', 'volume_name': 'volume-cabc3919-1f98-4236-97ab-9c0ade34b137', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9c14c4-289f-4f65-a068-7227f683e5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a9c14c4-289f-4f65-a068-7227f683e5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15706356-84e0-4167-955b-d7540126c706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Volume cabc3919-1f98-4236-97ab-9c0ade34b137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabc3919-1f98-4236-97ab-9c0ade34b137', 'volume_size': 1} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:48 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb Aug 26 03:07:48 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:48 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb" returned: 0 in 0.370s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] <== create_volume: return (2172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.404s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-270934533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabc3919-1f98-4236-97ab-9c0ade34b137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da78241572594c98ad8e5d02631c1e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:48Z,use_quota=True,user_id='c7416a13fedf4c458798b402b060821f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Creating volume cabc3919-1f98-4236-97ab-9c0ade34b137 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:48 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (263dd489-749f-407d-bbdc-ee9084f309a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:48 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 1073741824 Aug 26 03:07:48 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d9c78f-0d4d-49e0-acd1-71ef1c74b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Volume volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb (46bb4dd9-74f6-4fde-9d79-fd238633a1eb): created successfully Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84d9c78f-0d4d-49e0-acd1-71ef1c74b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Flow 'volume_create_manager' (28aaa4e6-54fa-4369-8f68-3199865ce399) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a6fe3d18-804f-4a19-a893-ada94c2e3c95 tempest-GroupsTest-1253881912 None] Created volume successfully. Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Flow 'volume_create_manager' (aa6609a5-e00b-499c-a297-ed3b179ccaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662e4308-4f29-4b1b-a3fa-3d819cbffd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662e4308-4f29-4b1b-a3fa-3d819cbffd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1665308072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5faf07b-f288-4f76-918e-c5c31a53c919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ba2eb42c8a4530859c50ad71cf6e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:50Z,use_quota=True,user_id='5c83f8fde4b04b1a8ef942950f0ba554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a820e1-7884-480c-b469-c01eb664c66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0a820e1-7884-480c-b469-c01eb664c66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff3766f-9785-4be5-8b78-70b1f73d2693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff3766f-9785-4be5-8b78-70b1f73d2693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5faf07b-f288-4f76-918e-c5c31a53c919', 'volume_name': 'volume-a5faf07b-f288-4f76-918e-c5c31a53c919', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0db307-8338-4f2c-a181-efbf29a4b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0db307-8338-4f2c-a181-efbf29a4b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:49 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88be7c7-3029-47a9-bb35-d91108a093b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:49 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Volume a5faf07b-f288-4f76-918e-c5c31a53c919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5faf07b-f288-4f76-918e-c5c31a53c919', 'volume_size': 1} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 1073741824" returned: 0 in 1.139s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:50 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 Aug 26 03:07:50 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Flow 'volume_create_manager' (80fb7659-6b25-4cbf-bd80-4e7ac339ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b304a52-ff46-4970-94d9-200049b0b57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b304a52-ff46-4970-94d9-200049b0b57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-93478080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaa6729a-ea5d-4976-afd0-33aeb7c5b219,host='devstack@QuobyteHD#QuobyteHD',id=cd3973d7-0469-456c-b77c-39520db41a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c92ee83e58e4be5b679614c910d8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:51Z,use_quota=True,user_id='49727133b8a94884b52d442f687c5f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8),volume_type_id=c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e13fd70-cdf6-44ea-8795-e19ee3a397d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e13fd70-cdf6-44ea-8795-e19ee3a397d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c4d300-db77-447f-8ab2-8fb30f3fdf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39c4d300-db77-447f-8ab2-8fb30f3fdf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3973d7-0469-456c-b77c-39520db41a86', 'volume_name': 'volume-cd3973d7-0469-456c-b77c-39520db41a86', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a43b4-1c74-4d33-afb0-a79f79b79757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc6a43b4-1c74-4d33-afb0-a79f79b79757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdaeff51-1bd3-40e3-bb11-93779deb32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:50 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Volume cd3973d7-0469-456c-b77c-39520db41a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3973d7-0469-456c-b77c-39520db41a86', 'volume_size': 1} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:50 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137" returned: 0 in 0.722s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] <== create_volume: return (1930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.937s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.794s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1665308072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5faf07b-f288-4f76-918e-c5c31a53c919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ba2eb42c8a4530859c50ad71cf6e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:50Z,use_quota=True,user_id='5c83f8fde4b04b1a8ef942950f0ba554',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Creating volume a5faf07b-f288-4f76-918e-c5c31a53c919 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:50 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15706356-84e0-4167-955b-d7540126c706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabc3919-1f98-4236-97ab-9c0ade34b137', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:50 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 1073741824 Aug 26 03:07:50 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93cb446-1260-491d-83b2-9c0468217380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:50 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Volume volume-cabc3919-1f98-4236-97ab-9c0ade34b137 (cabc3919-1f98-4236-97ab-9c0ade34b137): created successfully Aug 26 03:07:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93cb446-1260-491d-83b2-9c0468217380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Flow 'volume_create_manager' (7e34e2c7-5f1e-405d-98a6-ab7ec48182f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c0f614e8-7b6e-493c-adf9-e70ea9f71f99 tempest-TestMinimumBasicScenario-1214856280 None] Created volume successfully. Aug 26 03:07:51 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 1073741824" returned: 0 in 0.897s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:51 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 Aug 26 03:07:51 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:52 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919" returned: 0 in 0.688s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.742s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eaa6729a-ea5d-4976-afd0-33aeb7c5b219,created_at=2026-08-26T01:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-93478080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eaa6729a-ea5d-4976-afd0-33aeb7c5b219,host='devstack@QuobyteHD#QuobyteHD',id=cd3973d7-0469-456c-b77c-39520db41a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c92ee83e58e4be5b679614c910d8aad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:07:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:07:51Z,use_quota=True,user_id='49727133b8a94884b52d442f687c5f7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8),volume_type_id=c13b51ff-5e9f-4ba8-8bcf-c31ef38b3ef8)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Creating volume cd3973d7-0469-456c-b77c-39520db41a86 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:07:52 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88be7c7-3029-47a9-bb35-d91108a093b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5faf07b-f288-4f76-918e-c5c31a53c919', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f08b676-d920-4eb2-a35a-685360811089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:52 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 1073741824 Aug 26 03:07:52 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:52 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Volume volume-a5faf07b-f288-4f76-918e-c5c31a53c919 (a5faf07b-f288-4f76-918e-c5c31a53c919): created successfully Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f08b676-d920-4eb2-a35a-685360811089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Flow 'volume_create_manager' (aa6609a5-e00b-499c-a297-ed3b179ccaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:52 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-225012ae-b3a5-4fcc-9586-78d0732ce372 tempest-AttachVolumeShelveTestJSON-327533649 None] Created volume successfully. Aug 26 03:07:53 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 1073741824" returned: 0 in 0.764s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:53 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 Aug 26 03:07:53 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:07:54 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86" returned: 0 in 0.648s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdaeff51-1bd3-40e3-bb11-93779deb32a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3973d7-0469-456c-b77c-39520db41a86', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28a2fe1-ab5e-4b30-b51f-ef5b0198def6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:07:54 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Volume volume-cd3973d7-0469-456c-b77c-39520db41a86 (cd3973d7-0469-456c-b77c-39520db41a86): created successfully Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28a2fe1-ab5e-4b30-b51f-ef5b0198def6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Flow 'volume_create_manager' (80fb7659-6b25-4cbf-bd80-4e7ac339ad73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-042b8569-5d23-4044-b6d1-b27ad1844020 req-bb173e24-9c0d-42b7-8497-80ae180a91e3 tempest-TestMinimumBasicScenario-1214856280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-042b8569-5d23-4044-b6d1-b27ad1844020 req-bb173e24-9c0d-42b7-8497-80ae180a91e3 tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:07:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5291118f-799d-4ebb-bde0-d00da45728b9 tempest-GroupsTest-1253881912 None] Created volume successfully. Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-042b8569-5d23-4044-b6d1-b27ad1844020 req-bb173e24-9c0d-42b7-8497-80ae180a91e3 tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:07:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-042b8569-5d23-4044-b6d1-b27ad1844020 req-bb173e24-9c0d-42b7-8497-80ae180a91e3 tempest-TestMinimumBasicScenario-1214856280 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-cabc3919-1f98-4236-97ab-9c0ade34b137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d83b8b7-3491-49af-b4e9-de3d7e6adaa3', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:07:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-042b8569-5d23-4044-b6d1-b27ad1844020 req-bb173e24-9c0d-42b7-8497-80ae180a91e3 tempest-TestMinimumBasicScenario-1214856280 None] attachment_update completed successfully. Aug 26 03:07:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e24c8f49-97cf-4609-8f5b-45e8c58344c5 tempest-GroupsTest-1253881912 None] Update group completed successfully. Aug 26 03:07:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-96cc4cc6-c054-45e4-bb82-a62594b89694 tempest-GroupsTest-1253881912 None] Update group completed successfully. Aug 26 03:07:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Acquiring lock "cinder-quobyte-46bb4dd9-74f6-4fde-9d79-fd238633a1eb" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:07:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Lock "cinder-quobyte-46bb4dd9-74f6-4fde-9d79-fd238633a1eb" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:07:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d766ce94-eba9-44c1-8dfa-83f6738dd4c8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:07:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:07:59 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb Aug 26 03:07:59 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:00 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb" returned: 0 in 0.555s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:00 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb Aug 26 03:08:00 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:00 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-46bb4dd9-74f6-4fde-9d79-fd238633a1eb" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Lock "cinder-quobyte-46bb4dd9-74f6-4fde-9d79-fd238633a1eb" released by "delete_volume" :: held 0.988s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Acquiring lock "cinder-quobyte-cd3973d7-0469-456c-b77c-39520db41a86" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Lock "cinder-quobyte-cd3973d7-0469-456c-b77c-39520db41a86" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e6f6d2-3da6-441d-abf3-2d93b33e2f28]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:00 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 Aug 26 03:08:00 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:01 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86" returned: 0 in 0.606s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:01 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86 Aug 26 03:08:01 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:01 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cd3973d7-0469-456c-b77c-39520db41a86" returned: 0 in 0.569s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Lock "cinder-quobyte-cd3973d7-0469-456c-b77c-39520db41a86" released by "delete_volume" :: held 1.252s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Created reservations ['9a97d125-c713-4cf4-bef1-630b98a326dd'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:02 devstack cinder-volume[94506]: WARNING cinder.quota [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1105205921 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1105205921, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:08:02 devstack cinder-volume[94506]: WARNING cinder.quota [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1105205921 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1105205921, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Created reservations ['20a4088c-8386-418c-9ff0-e275a0f1faca', 'c3ddf16b-1fb7-472f-9084-7fc1435913b1', '5ccaf8bf-3e81-420d-9259-5085e3e36864', 'd22b34eb-ccdc-4193-8734-0ac27371180f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Created reservations ['c71d7f97-a2f4-46a3-b3e5-416a64292194', 'c219d7b5-8295-4cc7-814d-614098516d32', '92a163b1-6a7d-46e8-8aac-9532f97de8d8', 'f746b5e6-04a2-4d23-adc2-be070465cbf0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:02 devstack sudo[107471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:08:02 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:03 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.527s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:03 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4161e020-b34e-4ee2-be47-2dae720a72f8 tempest-GroupsTest-1253881912 None] Delete group completed successfully. Aug 26 03:08:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-cb84dd93-640b-4fdd-aec9-3f872ceadde0 req-7667419f-62b8-40af-b620-7bb6821a4aaf tempest-AttachVolumeShelveTestJSON-327533649 None] No connector for attachment 0b406e92-8a7b-4793-8784-eba79e9e051f; skipping storage backend terminate_connection call. {{(pid=94506) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 26 03:08:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-cb84dd93-640b-4fdd-aec9-3f872ceadde0 req-7667419f-62b8-40af-b620-7bb6821a4aaf tempest-AttachVolumeShelveTestJSON-327533649 None] Deleting attachment 0b406e92-8a7b-4793-8784-eba79e9e051f. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:20 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:08:20 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:20 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:08:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:08:22 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=48,cinder:SELECT=56,cinder:INSERT=15,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:08:22 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=65,cinder:UPDATE=62,cinder:INSERT=5,cinder:DELETE=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:08:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-6257ae78-298f-4608-8ddb-c64d84ae8b2e tempest-TestShelveInstance-877367132 None] Terminate volume connection completed successfully. Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-6257ae78-298f-4608-8ddb-c64d84ae8b2e tempest-TestShelveInstance-877367132 None] Deleting attachment 3592f967-3f79-4e2b-8507-5663364ccf55. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Flow 'volume_create_manager' (663aa702-d38b-4dfa-a102-7007c5887c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3879e32-6b5e-4f82-a6d1-0e1644c8df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3879e32-6b5e-4f82-a6d1-0e1644c8df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-746666857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90d6e6b-39ab-4500-ab6a-09851c7f9577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af1dd8218d54e788556289f1f5e345e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:32Z,use_quota=True,user_id='fce37d398d6e4972a9bf3d698e7e18cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b59ac97-d0a2-4979-99b4-2136fdafc38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b59ac97-d0a2-4979-99b4-2136fdafc38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30a0309-a079-43ec-96ca-3968903b46a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30a0309-a079-43ec-96ca-3968903b46a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f90d6e6b-39ab-4500-ab6a-09851c7f9577', 'volume_name': 'volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a315710d-075d-40ea-9dd8-00af642fe5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a315710d-075d-40ea-9dd8-00af642fe5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e0be90-474f-4700-b1de-b9117ab52907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Volume f90d6e6b-39ab-4500-ab6a-09851c7f9577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577', 'volume_size': 1} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-746666857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f90d6e6b-39ab-4500-ab6a-09851c7f9577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6af1dd8218d54e788556289f1f5e345e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:32Z,use_quota=True,user_id='fce37d398d6e4972a9bf3d698e7e18cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Creating volume f90d6e6b-39ab-4500-ab6a-09851c7f9577 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:32 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:32 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 1073741824 Aug 26 03:08:32 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Acquiring lock "cinder-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Lock "cinder-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Acquiring lock "cinder-quobyte-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Lock "cinder-quobyte-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fd3c12-922f-482e-a2a8-06214efdada3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:33 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e Aug 26 03:08:33 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:33 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 1073741824" returned: 0 in 0.789s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:33 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 Aug 26 03:08:33 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:33 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" returned: 0 in 0.783s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:33 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e Aug 26 03:08:33 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:34 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577" returned: 0 in 0.458s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e0be90-474f-4700-b1de-b9117ab52907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8528a2f5-eb86-4aa9-8c89-518715730069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:34 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Volume volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 (f90d6e6b-39ab-4500-ab6a-09851c7f9577): created successfully Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8528a2f5-eb86-4aa9-8c89-518715730069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Flow 'volume_create_manager' (663aa702-d38b-4dfa-a102-7007c5887c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:34 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-282e0fa6-3db4-4a5a-84f5-1b1ce75d4efd tempest-VolumesServicesTestJSON-2011776637 None] Created volume successfully. Aug 26 03:08:34 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" returned: 0 in 0.373s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Lock "cinder-quobyte-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e" released by "delete_volume" :: held 1.258s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.quota [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Created reservations ['0014e77d-ccda-4e6c-a75d-50503abc36b7', '4bc8a6f6-d99e-4fe8-b3e8-541d760d747f', '4cf15827-0832-41c3-a96c-e8d7bca8a185', '878ce5e7-c18a-441c-930a-0e5d56c1b5a1'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:34 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:08:34 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:34 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.317s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.manager [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:34 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Deleted volume successfully. Aug 26 03:08:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [req-3d1f8d9f-d126-45ed-bc4d-14753c41a91d req-237202ee-24fe-4fda-aec5-a05502a486af tempest-TestShelveInstance-877367132 None] Lock "cinder-c990993e-b6bd-4bbd-9d7c-c30e9bfb964e-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Acquiring lock "cinder-f90d6e6b-39ab-4500-ab6a-09851c7f9577-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Lock "cinder-f90d6e6b-39ab-4500-ab6a-09851c7f9577-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Acquiring lock "cinder-quobyte-f90d6e6b-39ab-4500-ab6a-09851c7f9577" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Lock "cinder-quobyte-f90d6e6b-39ab-4500-ab6a-09851c7f9577" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb83085-6e44-413f-96e5-b7f6a693830a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:35 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 Aug 26 03:08:35 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:35 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577" returned: 0 in 0.436s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:35 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577 Aug 26 03:08:35 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:36 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f90d6e6b-39ab-4500-ab6a-09851c7f9577" returned: 0 in 0.428s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Lock "cinder-quobyte-f90d6e6b-39ab-4500-ab6a-09851c7f9577" released by "delete_volume" :: held 0.933s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Created reservations ['e5f8fe17-2259-4048-95ab-be18b3eaccf5', 'c1e40014-16c7-48a8-b412-1a16d57d3fbe', '8b164800-75ba-4bdc-9041-78efa954f971', 'e8d080f6-eb7a-4ae1-8113-93055441748b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:36 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:08:36 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:36 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Deleted volume successfully. Aug 26 03:08:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-11acac6d-e614-405a-ae55-c8ad49eb655b tempest-VolumesServicesTestJSON-2011776637 None] Lock "cinder-f90d6e6b-39ab-4500-ab6a-09851c7f9577-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:46 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=16,cinder:UPDATE=20,cinder:INSERT=5 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:08:46 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=10,cinder:UPDATE=18,cinder:DELETE=3,cinder:INSERT=4 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (ab557ae7-f27d-4bc4-80a7-c8527b1b04f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb92223-cbe8-4067-bbcc-27f4477b2e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb92223-cbe8-4067-bbcc-27f4477b2e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527167691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52224b28-b8af-4a7d-be38-fe7fd7cbc850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:53Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd657ee-9601-403c-9054-a80b4250d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd657ee-9601-403c-9054-a80b4250d006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4672ec52-97d3-4ff5-b94a-01517ba19dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4672ec52-97d3-4ff5-b94a-01517ba19dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52224b28-b8af-4a7d-be38-fe7fd7cbc850', 'volume_name': 'volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14beaaca-2f87-4c1f-8e87-0a4e1ad6f29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14beaaca-2f87-4c1f-8e87-0a4e1ad6f29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1de656-00ce-4e47-89bf-d8f52cc028b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume 52224b28-b8af-4a7d-be38-fe7fd7cbc850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850', 'volume_size': 1} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-527167691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52224b28-b8af-4a7d-be38-fe7fd7cbc850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:53Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Creating volume 52224b28-b8af-4a7d-be38-fe7fd7cbc850 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:53 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:53 devstack sudo[107869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 1073741824 Aug 26 03:08:53 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Flow 'volume_create_manager' (bfcb296a-1edd-4d94-9af1-6169d12e9cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbe24d7-63a2-4c0a-aea3-a15333d4472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bbe24d7-63a2-4c0a-aea3-a15333d4472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-102188592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db81f1d-05e6-4150-82e4-43cf6ea6ba9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244008f7190441ffa1436c6b6986a029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:53Z,use_quota=True,user_id='4eb5242632c648f7a0f5b14bad48c4a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed2dfe8f-708e-4132-93a7-22604dd984c9),volume_type_id=ed2dfe8f-708e-4132-93a7-22604dd984c9)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ed3e4e-fbf8-4f7a-bf9c-f92e43d305f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6ed3e4e-fbf8-4f7a-bf9c-f92e43d305f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a023f602-c09a-45bb-9ee7-ea1b3d6864bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a023f602-c09a-45bb-9ee7-ea1b3d6864bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db81f1d-05e6-4150-82e4-43cf6ea6ba9c', 'volume_name': 'volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dba234-7501-4ed6-9690-b9affb57c241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dba234-7501-4ed6-9690-b9affb57c241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00093c4f-c1d5-4bfa-8d22-9a5ffeb14285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Volume 5db81f1d-05e6-4150-82e4-43cf6ea6ba9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c', 'volume_size': 1} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:53 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 1073741824" returned: 0 in 0.708s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:53 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 Aug 26 03:08:53 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:54 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850" returned: 0 in 0.338s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.670s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-102188592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db81f1d-05e6-4150-82e4-43cf6ea6ba9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='244008f7190441ffa1436c6b6986a029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:53Z,use_quota=True,user_id='4eb5242632c648f7a0f5b14bad48c4a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed2dfe8f-708e-4132-93a7-22604dd984c9),volume_type_id=ed2dfe8f-708e-4132-93a7-22604dd984c9)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Creating volume 5db81f1d-05e6-4150-82e4-43cf6ea6ba9c {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:54 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:54 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c 1073741824 Aug 26 03:08:54 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1de656-00ce-4e47-89bf-d8f52cc028b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3406e-5286-4e15-8367-29b947640e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:54 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 (52224b28-b8af-4a7d-be38-fe7fd7cbc850): created successfully Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d3406e-5286-4e15-8367-29b947640e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (ab557ae7-f27d-4bc4-80a7-c8527b1b04f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-de77fb7e-d714-4df5-9e8d-01e91213677d tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created volume successfully. Aug 26 03:08:54 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c 1073741824" returned: 0 in 0.681s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:55 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c Aug 26 03:08:55 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Acquiring lock "cinder-a5faf07b-f288-4f76-918e-c5c31a53c919-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "cinder-a5faf07b-f288-4f76-918e-c5c31a53c919-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Acquiring lock "cinder-quobyte-a5faf07b-f288-4f76-918e-c5c31a53c919" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "cinder-quobyte-a5faf07b-f288-4f76-918e-c5c31a53c919" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ee73c-5b40-4a54-bf9d-d0f9829f5691]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:55 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c" returned: 0 in 0.473s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] <== create_volume: return (1242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00093c4f-c1d5-4bfa-8d22-9a5ffeb14285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb40fdd5-b126-46d6-9e73-866cec9ce9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Volume volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c (5db81f1d-05e6-4150-82e4-43cf6ea6ba9c): created successfully Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb40fdd5-b126-46d6-9e73-866cec9ce9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Flow 'volume_create_manager' (bfcb296a-1edd-4d94-9af1-6169d12e9cd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f9c49ad0-7662-4934-9e65-bd47f92846d9 tempest-VolumeTypesAccessTest-2073472373 None] Created volume successfully. Aug 26 03:08:55 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 Aug 26 03:08:55 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (851e4982-8210-4df6-9914-e8c30ce3858e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd2a85-c40b-4ef0-959e-a5cb48f0b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bd2a85-c40b-4ef0-959e-a5cb48f0b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-585226804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a548347-407f-4c4c-bd31-a7d4119f550e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:56Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236bd9d9-0bac-458c-9acc-51288033b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (236bd9d9-0bac-458c-9acc-51288033b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c757e2fe-b4a4-4d0b-8e62-1d557f7ac408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c757e2fe-b4a4-4d0b-8e62-1d557f7ac408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a548347-407f-4c4c-bd31-a7d4119f550e', 'volume_name': 'volume-9a548347-407f-4c4c-bd31-a7d4119f550e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a59ec8d-398f-4890-9924-cee01ac1a1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a59ec8d-398f-4890-9924-cee01ac1a1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422a70b8-dccc-4e20-95c2-8f6a5657eab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume 9a548347-407f-4c4c-bd31-a7d4119f550e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a548347-407f-4c4c-bd31-a7d4119f550e', 'volume_size': 1} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-585226804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a548347-407f-4c4c-bd31-a7d4119f550e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:56Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Creating volume 9a548347-407f-4c4c-bd31-a7d4119f550e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:55 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:55 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e 1073741824 Aug 26 03:08:56 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919 Aug 26 03:08:56 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (99cda28f-b611-4033-8301-cc3b3c8531b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:56 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd472b71-a506-467e-9762-9a999fc8815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a5faf07b-f288-4f76-918e-c5c31a53c919" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd472b71-a506-467e-9762-9a999fc8815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340353508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f706f541-abe6-4d4c-af59-983d729e0d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:56Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c16aaf-be9b-45b1-ad94-86bf5640e788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c16aaf-be9b-45b1-ad94-86bf5640e788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ef5636-7b41-41b0-823b-303684941df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55ef5636-7b41-41b0-823b-303684941df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f706f541-abe6-4d4c-af59-983d729e0d6b', 'volume_name': 'volume-f706f541-abe6-4d4c-af59-983d729e0d6b', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8f5cae-17ca-423e-9cd9-43699c7d4bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8f5cae-17ca-423e-9cd9-43699c7d4bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f054f8-449b-4f1e-9c5c-c43828dd3831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:56 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume f706f541-abe6-4d4c-af59-983d729e0d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f706f541-abe6-4d4c-af59-983d729e0d6b', 'volume_size': 1} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "cinder-quobyte-a5faf07b-f288-4f76-918e-c5c31a53c919" released by "delete_volume" :: held 1.141s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Created reservations ['cd70d764-6ec4-43fb-ab57-fb29b6a26dbb', '396b79ba-408f-49db-b9ac-0c65437059ca', '5dba5556-46c6-43df-9e72-a48b7441ed7a', '0a393ec8-a740-4760-bb67-934ce2a22965'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:56 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e 1073741824" returned: 0 in 0.679s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Acquiring lock "cinder-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:56 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:08:56 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Lock "cinder-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:56 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e Aug 26 03:08:56 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Acquiring lock "cinder-quobyte-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Lock "cinder-quobyte-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b762b795-a654-41df-a1ce-58ecc84b3771]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (f05ab443-634f-43e3-91de-4d88bcbd54f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bca8c9-94d5-4d1c-9a48-3001f112f2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37bca8c9-94d5-4d1c-9a48-3001f112f2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434715406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f34a91-3106-41de-bd20-a17654e35769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:57Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c89321-5b66-43d4-8ca4-0b23be8b427f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c89321-5b66-43d4-8ca4-0b23be8b427f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c318858c-3f8e-4fa7-90e7-f271254f0ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c318858c-3f8e-4fa7-90e7-f271254f0ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f34a91-3106-41de-bd20-a17654e35769', 'volume_name': 'volume-f0f34a91-3106-41de-bd20-a17654e35769', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f55c70c-1431-4f3c-9527-da1fca16d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f55c70c-1431-4f3c-9527-da1fca16d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c Aug 26 03:08:57 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75346d0b-6fb8-4595-93cd-84449a6f4d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume f0f34a91-3106-41de-bd20-a17654e35769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f34a91-3106-41de-bd20-a17654e35769', 'volume_size': 1} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:57 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e" returned: 0 in 0.464s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:57 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.741s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-340353508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f706f541-abe6-4d4c-af59-983d729e0d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:56Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Creating volume f706f541-abe6-4d4c-af59-983d729e0d6b {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:57 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.543s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:57 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b 1073741824 Aug 26 03:08:57 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422a70b8-dccc-4e20-95c2-8f6a5657eab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a548347-407f-4c4c-bd31-a7d4119f550e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6561fdcb-bf8e-4243-b655-1bd7e5f61b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Deleted volume successfully. Aug 26 03:08:57 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume volume-9a548347-407f-4c4c-bd31-a7d4119f550e (9a548347-407f-4c4c-bd31-a7d4119f550e): created successfully Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6561fdcb-bf8e-4243-b655-1bd7e5f61b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (851e4982-8210-4df6-9914-e8c30ce3858e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5f43561c-db58-45b4-ada4-00e5840c2d70 tempest-AttachVolumeShelveTestJSON-327533649 None] Lock "cinder-a5faf07b-f288-4f76-918e-c5c31a53c919-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-60a47a89-2608-4290-84f9-1d42ccbed8dc tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created volume successfully. Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (0b5b5c12-8738-41c5-94ab-c23a0dfe48e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c8cd8c-fb89-42a6-b585-3d7ceecba328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c" returned: 0 in 0.570s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45c8cd8c-fb89-42a6-b585-3d7ceecba328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894332569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:57Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cc3f07-5f19-4efc-93fb-7cbc6e60d488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cc3f07-5f19-4efc-93fb-7cbc6e60d488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c Aug 26 03:08:57 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c570eb85-7d59-4ce8-87dd-4b1a879aad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c570eb85-7d59-4ce8-87dd-4b1a879aad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e', 'volume_name': 'volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bcaeba-b3e1-49d5-8878-8b4488e4f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bcaeba-b3e1-49d5-8878-8b4488e4f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db975194-1be0-4b59-a4b6-69157ac7749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:57 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume 9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e', 'volume_size': 1} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:57 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c" returned: 0 in 0.359s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Lock "cinder-quobyte-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c" released by "delete_volume" :: held 0.994s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:57 devstack cinder-volume[94506]: WARNING cinder.quota [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-325171905 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-325171905, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:08:57 devstack cinder-volume[94506]: WARNING cinder.quota [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-325171905 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-325171905, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:08:57 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b 1073741824" returned: 0 in 0.719s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Created reservations ['d5d3d71c-45f9-4255-9d14-596cb805df7f', '76e55d02-6fd9-4a61-b222-4a4a9c1dd498', '44cc556f-7465-4d26-9baa-7cdd165aeadf', 'fe2d964b-4a9e-4503-ac15-31cc3f2945e6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (f8c5fc0c-3c77-46c2-81c2-c0cd522d5642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60f8ab9-c993-48b7-8be2-86d844fb241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a60f8ab9-c993-48b7-8be2-86d844fb241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182837643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:58Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709ee7e0-0a7c-4a3d-ad47-ecaf681cee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (709ee7e0-0a7c-4a3d-ad47-ecaf681cee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae0d371-f46c-49ce-b750-5ed0b9f4ee37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae0d371-f46c-49ce-b750-5ed0b9f4ee37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d', 'volume_name': 'volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae9ecf4-e4d6-4be9-9743-34cec384d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae9ecf4-e4d6-4be9-9743-34cec384d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ac18e0-8813-4bf6-ae3f-3394fac257b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:58 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d', 'volume_size': 1} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:58 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b Aug 26 03:08:58 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:58 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:08:58 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:58 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.325s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1434715406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f34a91-3106-41de-bd20-a17654e35769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:57Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Creating volume f0f34a91-3106-41de-bd20-a17654e35769 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:58 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:58 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 1073741824 Aug 26 03:08:58 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18f054f8-449b-4f1e-9c5c-c43828dd3831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f706f541-abe6-4d4c-af59-983d729e0d6b', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3cf2b0-a876-4baa-9177-3c828cf2cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:58 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume volume-f706f541-abe6-4d4c-af59-983d729e0d6b (f706f541-abe6-4d4c-af59-983d729e0d6b): created successfully Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3cf2b0-a876-4baa-9177-3c828cf2cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (99cda28f-b611-4033-8301-cc3b3c8531b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-56116a12-4be5-4bad-831a-48cac1d72d5e tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created volume successfully. Aug 26 03:08:58 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.346s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:08:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Deleted volume successfully. Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-57f79ab7-5d4a-4db8-a652-f91ddbc37b72 tempest-VolumeTypesAccessTest-2073472373 None] Lock "cinder-5db81f1d-05e6-4150-82e4-43cf6ea6ba9c-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:08:58 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 1073741824" returned: 0 in 0.539s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:59 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 Aug 26 03:08:59 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:59 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769" returned: 0 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.744s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-894332569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:57Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Creating volume 9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:08:59 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75346d0b-6fb8-4595-93cd-84449a6f4d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f34a91-3106-41de-bd20-a17654e35769', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2776cab-5da8-4142-9037-a9e16676bfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:08:59 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e 1073741824 Aug 26 03:08:59 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:08:59 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume volume-f0f34a91-3106-41de-bd20-a17654e35769 (f0f34a91-3106-41de-bd20-a17654e35769): created successfully Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2776cab-5da8-4142-9037-a9e16676bfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (f05ab443-634f-43e3-91de-4d88bcbd54f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:08:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-08d9c536-d531-4028-af0f-5d189f0638ef tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created volume successfully. Aug 26 03:08:59 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e 1073741824" returned: 0 in 0.610s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:08:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:00 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e Aug 26 03:09:00 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:00 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e" returned: 0 in 0.328s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.201s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1182837643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4e113c6f36e47e4b152ab2aed60b556',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:08:58Z,use_quota=True,user_id='259381a1e84749f89c3e742795e209c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Creating volume db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:00 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db975194-1be0-4b59-a4b6-69157ac7749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:00 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d 1073741824 Aug 26 03:09:00 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37e8ee8-5766-4cfe-86a8-672af49a86de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:00 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e (9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e): created successfully Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d37e8ee8-5766-4cfe-86a8-672af49a86de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (0b5b5c12-8738-41c5-94ab-c23a0dfe48e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0e0694e6-7434-4ae7-80c9-4527b43fd0aa tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created volume successfully. Aug 26 03:09:00 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d 1073741824" returned: 0 in 0.636s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:01 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d Aug 26 03:09:01 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:01 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ac18e0-8813-4bf6-ae3f-3394fac257b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba6e584-6cf9-43f6-9f25-5ecb959d09fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:01 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Volume volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d (db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d): created successfully Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba6e584-6cf9-43f6-9f25-5ecb959d09fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Flow 'volume_create_manager' (f8c5fc0c-3c77-46c2-81c2-c0cd522d5642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b7bdd275-cf7b-40f4-a1db-76b0672dba42 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created volume successfully. Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-quobyte-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b8dfa4-a979-4871-9337-d55f946792fa]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:01 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d Aug 26 03:09:01 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d" returned: 0 in 0.438s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d Aug 26 03:09:02 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d" returned: 0 in 0.375s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d" released by "delete_volume" :: held 0.884s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created reservations ['57b373ae-847e-4507-8912-5bcf664cd7f6', 'c1b5ccdb-ae0e-4f5d-b62f-e4ea7fee09c1', '75f67d6b-d3be-4867-9fea-e0a6bd577596', '27852eba-13a1-45c6-b687-30362a186584'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:02 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:02 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-quobyte-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb2470-a7df-4d12-b167-551b67cdd90e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:03 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Deleted volume successfully. Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f362cb39-7818-4139-8fd0-408b99fb1aca tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-db78ae0d-82b5-4bbf-b12f-84dd24f6ac2d-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:03 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e Aug 26 03:09:03 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:03 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e" returned: 0 in 0.580s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:03 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e Aug 26 03:09:03 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:04 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e" returned: 0 in 0.340s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e" released by "delete_volume" :: held 1.005s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created reservations ['946031d3-a792-42d0-ad9e-6c8a7afef03d', '1b417a1d-22e1-4d95-b97d-ee79efd5b8ca', 'ab07540c-3e92-4954-a962-e65c6e60e40d', '0b0bdd13-598a-4256-b131-60f5cdf5dead'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:04 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:04 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:04 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.355s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:04 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Deleted volume successfully. Aug 26 03:09:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2a7faf68-fc34-4034-a16d-e453bffb9bf1 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-9fcedfb8-ce95-4d24-8f3b-30fef4f5d57e-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-f0f34a91-3106-41de-bd20-a17654e35769-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-f0f34a91-3106-41de-bd20-a17654e35769-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-quobyte-f0f34a91-3106-41de-bd20-a17654e35769" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-f0f34a91-3106-41de-bd20-a17654e35769" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc617df-a8ba-4479-a77f-04207b91d938]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:05 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 Aug 26 03:09:05 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:05 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769" returned: 0 in 0.571s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:06 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769 Aug 26 03:09:06 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:06 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0f34a91-3106-41de-bd20-a17654e35769" returned: 0 in 0.366s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-f0f34a91-3106-41de-bd20-a17654e35769" released by "delete_volume" :: held 0.990s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created reservations ['3237aa81-b4f6-4e47-a309-ca680c41a5f7', '6510a95d-17c7-4b87-8db2-12e5a53cefc2', '711e6eca-0374-496f-aeef-aaab8a789141', 'de6428af-ed86-4769-8963-1712417b9e32'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:06 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:06 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:07 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Deleted volume successfully. Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e036a559-1797-4cc9-b052-832e761b1be3 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-f0f34a91-3106-41de-bd20-a17654e35769-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-f706f541-abe6-4d4c-af59-983d729e0d6b-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-f706f541-abe6-4d4c-af59-983d729e0d6b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-quobyte-f706f541-abe6-4d4c-af59-983d729e0d6b" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-f706f541-abe6-4d4c-af59-983d729e0d6b" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb5132-e102-4b8e-bb07-c69cc03c80f1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:08 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b Aug 26 03:09:08 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:08 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b" returned: 0 in 0.562s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:08 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b Aug 26 03:09:08 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:08 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f706f541-abe6-4d4c-af59-983d729e0d6b" returned: 0 in 0.395s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-f706f541-abe6-4d4c-af59-983d729e0d6b" released by "delete_volume" :: held 1.037s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:08 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created reservations ['a87185f1-ece9-4f14-a863-77f2d031e3ba', '18f4bcfa-6135-4706-b392-77f00cafd4da', 'f6b3f2ed-5ff1-4ba6-8890-4ce6287f6e23', '2c6681bd-4494-42bb-9aec-8110824cd265'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:09 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:09 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Flow 'volume_create_manager' (127b1615-14b4-49e6-8a21-7d0591ab14bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f542e5-be5d-4d92-afff-02e9400e9172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f542e5-be5d-4d92-afff-02e9400e9172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1129626012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e825b9b9-e673-4e6a-8222-3868975a2cf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d8fa54e05f4402ab8679c89e609ff5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:09Z,use_quota=True,user_id='cab6eddb9bbc455da2ca89282a181792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab6e274-b929-47d0-8964-5eb6eb5e8de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab6e274-b929-47d0-8964-5eb6eb5e8de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2661e1d-45d1-458b-9afc-5ba906d505a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2661e1d-45d1-458b-9afc-5ba906d505a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e825b9b9-e673-4e6a-8222-3868975a2cf8', 'volume_name': 'volume-e825b9b9-e673-4e6a-8222-3868975a2cf8', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1338b26e-0266-497f-8dfc-c4af97dbfb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1338b26e-0266-497f-8dfc-c4af97dbfb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07432f5-d0d1-4dc9-9390-a23450227b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:09 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Volume e825b9b9-e673-4e6a-8222-3868975a2cf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e825b9b9-e673-4e6a-8222-3868975a2cf8', 'volume_size': 1} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1129626012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e825b9b9-e673-4e6a-8222-3868975a2cf8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d8fa54e05f4402ab8679c89e609ff5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:09Z,use_quota=True,user_id='cab6eddb9bbc455da2ca89282a181792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Creating volume e825b9b9-e673-4e6a-8222-3868975a2cf8 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:09 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:09 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.431s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Deleted volume successfully. Aug 26 03:09:09 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 1073741824 Aug 26 03:09:09 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8528451-4aaf-460a-9fca-cbd4fcd58b11 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-f706f541-abe6-4d4c-af59-983d729e0d6b-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-f01c8d2d-63e3-4a0b-b8b3-8bd8ddfffb7b req-d371c007-cd14-4c41-ab23-539828c0f0fb tempest-TestMinimumBasicScenario-1214856280 None] Terminate volume connection completed successfully. Aug 26 03:09:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-f01c8d2d-63e3-4a0b-b8b3-8bd8ddfffb7b req-d371c007-cd14-4c41-ab23-539828c0f0fb tempest-TestMinimumBasicScenario-1214856280 None] Deleting attachment 2d83b8b7-3491-49af-b4e9-de3d7e6adaa3. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-9a548347-407f-4c4c-bd31-a7d4119f550e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-9a548347-407f-4c4c-bd31-a7d4119f550e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-quobyte-9a548347-407f-4c4c-bd31-a7d4119f550e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-9a548347-407f-4c4c-bd31-a7d4119f550e" acquired by "delete_volume" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcc0bc9-a785-48ca-ab6a-90424b85aa6d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:10 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 1073741824" returned: 0 in 0.828s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Acquiring lock "cinder-cabc3919-1f98-4236-97ab-9c0ade34b137-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Lock "cinder-cabc3919-1f98-4236-97ab-9c0ade34b137-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:10 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e Aug 26 03:09:10 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:10 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 Aug 26 03:09:10 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Acquiring lock "cinder-quobyte-cabc3919-1f98-4236-97ab-9c0ade34b137" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Lock "cinder-quobyte-cabc3919-1f98-4236-97ab-9c0ade34b137" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[115207fb-8421-4927-88d4-3e95cc71900e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:10 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 Aug 26 03:09:10 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:10 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e" returned: 0 in 0.552s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:10 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:10 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8" returned: 0 in 0.439s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:10 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b07432f5-d0d1-4dc9-9390-a23450227b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e825b9b9-e673-4e6a-8222-3868975a2cf8', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9c7540-92fd-4702-ad2a-5f0894f17ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:10 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Volume volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 (e825b9b9-e673-4e6a-8222-3868975a2cf8): created successfully Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc9c7540-92fd-4702-ad2a-5f0894f17ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Flow 'volume_create_manager' (127b1615-14b4-49e6-8a21-7d0591ab14bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ba64a081-b321-4e19-be9f-5b00c03dc2b9 tempest-VolumesTestJSON-1498389319 None] Created volume successfully. Aug 26 03:09:11 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137" returned: 0 in 0.523s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:11 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137 Aug 26 03:09:11 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:11 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a548347-407f-4c4c-bd31-a7d4119f550e" returned: 0 in 0.339s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-9a548347-407f-4c4c-bd31-a7d4119f550e" released by "delete_volume" :: held 0.955s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created reservations ['3a35fa87-5068-450b-bc12-bbc6ccab4002', 'f9699496-e031-49d8-94c3-c059e01377d7', 'c73382ce-8b27-414f-b6ac-a2bcfa754310', 'f43bb889-3220-44c0-a44b-ea0719c7aed8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:11 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:11 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:11 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cabc3919-1f98-4236-97ab-9c0ade34b137" returned: 0 in 0.341s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Lock "cinder-quobyte-cabc3919-1f98-4236-97ab-9c0ade34b137" released by "delete_volume" :: held 0.933s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Created reservations ['30055d4b-b9d6-4a1b-aa56-30cc72cb94e5', 'ebb133e0-c70a-4680-a504-08ce9192e880', 'c949aca8-fba6-490b-ba07-64f2d34d1976', 'b916af76-b2e0-47b3-a90b-43738ce129c9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:11 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:11 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:11 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.426s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Deleted volume successfully. Aug 26 03:09:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7417e2c0-d57e-4e51-b181-6ecf0f23eef2 tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-9a548347-407f-4c4c-bd31-a7d4119f550e-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:12 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.368s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Deleted volume successfully. Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-1613317c-b6be-4de6-86c2-3dbd064a64ea tempest-TestMinimumBasicScenario-1214856280 None] Lock "cinder-cabc3919-1f98-4236-97ab-9c0ade34b137-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Flow 'volume_create_manager' (59904b96-b72a-4c4e-9c7b-f561f46cdbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c28b741-1f9e-414a-9b02-31e9ff9d86bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c28b741-1f9e-414a-9b02-31e9ff9d86bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-364990597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d8fa54e05f4402ab8679c89e609ff5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:12Z,use_quota=True,user_id='cab6eddb9bbc455da2ca89282a181792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d3d97-dbf4-4e59-9b41-1ca2e6275ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (469d3d97-dbf4-4e59-9b41-1ca2e6275ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2a9871-6619-4d71-8c49-b22a9ddf2f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2a9871-6619-4d71-8c49-b22a9ddf2f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7', 'volume_name': 'volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b328a32-b8b2-4c0d-b291-df2a783a098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b328a32-b8b2-4c0d-b291-df2a783a098a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1968ed59-cb7b-4843-8ebf-531990025c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:12 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Volume eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7', 'volume_size': 1} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-364990597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d8fa54e05f4402ab8679c89e609ff5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:12Z,use_quota=True,user_id='cab6eddb9bbc455da2ca89282a181792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Creating volume eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:12 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-52224b28-b8af-4a7d-be38-fe7fd7cbc850-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:12 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 1073741824 Aug 26 03:09:12 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-52224b28-b8af-4a7d-be38-fe7fd7cbc850-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "cinder-quobyte-52224b28-b8af-4a7d-be38-fe7fd7cbc850" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-52224b28-b8af-4a7d-be38-fe7fd7cbc850" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[da232596-6c1a-415c-92d6-0739ad1ed88e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:12 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 Aug 26 03:09:12 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:13 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 1073741824" returned: 0 in 0.788s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:13 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850" returned: 0 in 0.789s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:13 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 Aug 26 03:09:13 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:13 devstack sudo[108075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850 Aug 26 03:09:13 devstack sudo[108075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:14 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7" returned: 0 in 0.686s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:14 devstack sudo[108075]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-52224b28-b8af-4a7d-be38-fe7fd7cbc850" returned: 0 in 0.650s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1968ed59-cb7b-4843-8ebf-531990025c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689cf79a-3814-4c35-aa0e-4685e341d044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-quobyte-52224b28-b8af-4a7d-be38-fe7fd7cbc850" released by "delete_volume" :: held 1.515s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:14 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Volume volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 (eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7): created successfully Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (689cf79a-3814-4c35-aa0e-4685e341d044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Flow 'volume_create_manager' (59904b96-b72a-4c4e-9c7b-f561f46cdbbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-464a9e62-cdfa-4b6b-814f-75d5addddd54 tempest-VolumesTestJSON-1498389319 None] Created volume successfully. Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Created reservations ['0d6739b8-4205-4328-9cf1-b385492e6887', 'a3035ace-70aa-49af-85e6-44c339d9354d', '0bc2e766-87e0-41b2-acff-9f3a8f9476cc', 'ce31a5b6-e140-43a1-b8c3-386c85be8e01'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:14 devstack sudo[108099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:14 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:14 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.427s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Deleted volume successfully. Aug 26 03:09:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d34f830f-2579-4e3f-a71e-ccfa5b00abbe tempest-CreateVolumesFromSourceVolumeTest-1919922004 None] Lock "cinder-52224b28-b8af-4a7d-be38-fe7fd7cbc850-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Flow 'volume_create_manager' (0f0cdfd8-d7c2-4db2-a29e-91c5e02409e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d622bd3f-d71e-4e57-9086-6002078fc778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d622bd3f-d71e-4e57-9086-6002078fc778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-850859945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdb20be-8ee2-478b-bbdc-540aac1b10f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d8fa54e05f4402ab8679c89e609ff5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:15Z,use_quota=True,user_id='cab6eddb9bbc455da2ca89282a181792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40323aa1-5d40-40f1-9961-355238c3d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40323aa1-5d40-40f1-9961-355238c3d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3895c5ed-fbc7-4924-a198-97e1bc5e117f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3895c5ed-fbc7-4924-a198-97e1bc5e117f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecdb20be-8ee2-478b-bbdc-540aac1b10f5', 'volume_name': 'volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d601f32-bdea-4495-8209-1cfc12ad4f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d601f32-bdea-4495-8209-1cfc12ad4f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9eb94c-c734-42ca-a42e-64c602f6157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:15 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Volume ecdb20be-8ee2-478b-bbdc-540aac1b10f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5', 'volume_size': 1} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-850859945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecdb20be-8ee2-478b-bbdc-540aac1b10f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4d8fa54e05f4402ab8679c89e609ff5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:15Z,use_quota=True,user_id='cab6eddb9bbc455da2ca89282a181792',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Creating volume ecdb20be-8ee2-478b-bbdc-540aac1b10f5 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:15 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:15 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 1073741824 Aug 26 03:09:15 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:16 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 1073741824" returned: 0 in 0.929s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:16 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 Aug 26 03:09:16 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:17 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5" returned: 0 in 0.356s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc9eb94c-c734-42ca-a42e-64c602f6157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8557b269-845e-463b-a2bb-914332b9253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Volume volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 (ecdb20be-8ee2-478b-bbdc-540aac1b10f5): created successfully Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8557b269-845e-463b-a2bb-914332b9253a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Flow 'volume_create_manager' (0f0cdfd8-d7c2-4db2-a29e-91c5e02409e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cff4a45d-b8ff-4f74-9e00-7c6755126d07 tempest-VolumesTestJSON-1498389319 None] Created volume successfully. Aug 26 03:09:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "cinder-ecdb20be-8ee2-478b-bbdc-540aac1b10f5-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-ecdb20be-8ee2-478b-bbdc-540aac1b10f5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "cinder-quobyte-ecdb20be-8ee2-478b-bbdc-540aac1b10f5" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-quobyte-ecdb20be-8ee2-478b-bbdc-540aac1b10f5" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc159c6-5a94-4e8c-8eaf-c372164f8a68]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:19 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 Aug 26 03:09:19 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:19 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5" returned: 0 in 0.495s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:19 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5 Aug 26 03:09:19 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:20 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ecdb20be-8ee2-478b-bbdc-540aac1b10f5" returned: 0 in 0.457s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-quobyte-ecdb20be-8ee2-478b-bbdc-540aac1b10f5" released by "delete_volume" :: held 1.018s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Created reservations ['667bbd19-588c-4210-a1ad-632d4b4fedbd', '6731fc8c-e81b-4424-9e92-00ddede2471f', 'eee168f0-10f9-40e6-9d9d-1087e63ca848', '1a546c25-3036-4a17-9c0d-310d8fef7c00'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:20 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:20 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Flow 'volume_create_manager' (769d8ac3-62e1-4c02-aa90-9764ab5a6e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecdac68-ba16-47d7-94c3-c06777db6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecdac68-ba16-47d7-94c3-c06777db6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1332675186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37cce19df142acb913087ac2b9227c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:20Z,use_quota=True,user_id='da6933d483944ff3a3ff91a1d21f0a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd8bd4-9dea-41af-b5bd-0589cdc7bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3dd8bd4-9dea-41af-b5bd-0589cdc7bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b93b17d-6542-4b7e-8cd0-93075b39edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b93b17d-6542-4b7e-8cd0-93075b39edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3', 'volume_name': 'volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c40c6ae-d76d-49ae-b938-fe3fe7e50f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c40c6ae-d76d-49ae-b938-fe3fe7e50f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2eba38-0650-4888-a468-52392ab7d194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Volume 4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3', 'volume_size': 1} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1332675186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37cce19df142acb913087ac2b9227c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:20Z,use_quota=True,user_id='da6933d483944ff3a3ff91a1d21f0a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Creating volume 4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:20 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 1073741824 Aug 26 03:09:20 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:20 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.456s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:09:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:09:20 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:20 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:21 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Deleted volume successfully. Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2d553912-67ca-4630-a901-b5e6eeb7b879 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-ecdb20be-8ee2-478b-bbdc-540aac1b10f5-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:21 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 1073741824" returned: 0 in 0.643s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:21 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 Aug 26 03:09:21 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Acquiring lock "cinder-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Lock "cinder-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Acquiring lock "cinder-quobyte-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Lock "cinder-quobyte-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e2c808-9b06-4f6a-ac23-13e43b621543]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:21 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" returned: 0 in 0.361s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:21 devstack sudo[108182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 Aug 26 03:09:21 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2eba38-0650-4888-a468-52392ab7d194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aa3507-769e-4116-a7a1-7456982a0ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Volume volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 (4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3): created successfully Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73aa3507-769e-4116-a7a1-7456982a0ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Flow 'volume_create_manager' (769d8ac3-62e1-4c02-aa90-9764ab5a6e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-962cd9a0-6f94-4511-86aa-3ca3443729cd tempest-VolumeDependencyTests-1984183705 None] Created volume successfully. Aug 26 03:09:21 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7" returned: 0 in 0.551s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:21 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7 Aug 26 03:09:22 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:22 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7" returned: 0 in 0.366s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Lock "cinder-quobyte-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7" released by "delete_volume" :: held 0.973s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Created reservations ['6c6a189e-6fe8-44c7-af1b-f2fcbdae4466', '9a5c3838-a6eb-488d-b7b8-afd9228802b0', 'f44293f9-687a-4649-89a0-51d84b7ae3d8', '5143a389-f831-4327-851c-e2765b5e0f17'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Creating offline snapshot cf782105-6278-4dbe-a568-fe10b0c24c26 of volume 4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad8d002-a37a-4ac2-88a2-40344ccb42a7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:22 devstack sudo[108193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:22 devstack sudo[108193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:22 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 Aug 26 03:09:22 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:22 devstack sudo[108193]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.387s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:22 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Deleted volume successfully. Aug 26 03:09:23 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" returned: 0 in 0.469s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-510f538a-12a0-4570-a2e1-51c0a22296ac tempest-VolumesTestJSON-1498389319 None] Lock "cinder-eeaafc2a-a51c-4bdf-8f14-bcf4068c9aa7-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:23 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 1G Aug 26 03:09:23 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Flow 'volume_create_manager' (3fcfa0b8-8a3a-4c0a-bcf0-e3a1363835df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bad5c0-5f5f-4ce1-be79-e2ac366e4487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "cinder-e825b9b9-e673-4e6a-8222-3868975a2cf8-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:23 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07bad5c0-5f5f-4ce1-be79-e2ac366e4487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-895428152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3aebc4-dc58-42d9-a80a-ce322efa1203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931543da033848f3b44f954166aafb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:23Z,use_quota=True,user_id='6a8010eab58a4141aa49c33c8e15a6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801538b5-19bd-47fa-b5c7-127d2e6eae8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (801538b5-19bd-47fa-b5c7-127d2e6eae8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8ffa39-87d3-40fd-9a3a-7256839f7423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8ffa39-87d3-40fd-9a3a-7256839f7423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3aebc4-dc58-42d9-a80a-ce322efa1203', 'volume_name': 'volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4663ce2d-245b-4572-bfc9-afb8ac3c2198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4663ce2d-245b-4572-bfc9-afb8ac3c2198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b5b7bb-f007-45ad-a62c-7d355c49d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:23 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Volume 4a3aebc4-dc58-42d9-a80a-ce322efa1203: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203', 'volume_size': 1} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 1G" returned: 0 in 0.681s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-e825b9b9-e673-4e6a-8222-3868975a2cf8-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:23 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 Aug 26 03:09:23 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "cinder-quobyte-e825b9b9-e673-4e6a-8222-3868975a2cf8" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-quobyte-e825b9b9-e673-4e6a-8222-3868975a2cf8" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad24e64-80ea-450d-9301-6ac01ebcb23e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:23 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 Aug 26 03:09:23 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:24 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26" returned: 0 in 0.370s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:24 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 is being set with open permissions: ugo+rw Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:24 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 Aug 26 03:09:24 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:24 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8" returned: 0 in 0.448s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:24 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8 Aug 26 03:09:24 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:24 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:24 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info Aug 26 03:09:24 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:24 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e825b9b9-e673-4e6a-8222-3868975a2cf8" returned: 0 in 0.315s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-quobyte-e825b9b9-e673-4e6a-8222-3868975a2cf8" released by "delete_volume" :: held 0.823s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Created reservations ['7c146786-c7e9-4bb6-b625-d538fb5d4417', '9ee53e9d-0068-4654-8ee8-19701b4f68f8', '42a95901-d867-496e-a42e-06861c42914b', '3d6282ec-af92-47cb-8a5b-4dcc7e9e3640'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:24 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info" returned: 0 in 0.316s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:24 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info is being set with open permissions: ugo+rw Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:24 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:24 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:24 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:24 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:25 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.268s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:25 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.info" returned: 0 in 0.305s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.664s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Deleted volume successfully. Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.472s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-895428152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3aebc4-dc58-42d9-a80a-ce322efa1203,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931543da033848f3b44f954166aafb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:23Z,use_quota=True,user_id='6a8010eab58a4141aa49c33c8e15a6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Creating volume 4a3aebc4-dc58-42d9-a80a-ce322efa1203 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:25 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:25 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 1073741824 Aug 26 03:09:25 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e74c6dc1-718b-4f48-af20-e5a2becd8e58 tempest-VolumesTestJSON-1498389319 None] Lock "cinder-e825b9b9-e673-4e6a-8222-3868975a2cf8-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-57b76df8-d096-4532-8f50-95b68d961a2f tempest-VolumeDependencyTests-1984183705 None] Create snapshot completed successfully Aug 26 03:09:25 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 1073741824" returned: 0 in 0.577s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:25 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 Aug 26 03:09:25 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:26 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203" returned: 0 in 0.367s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91b5b7bb-f007-45ad-a62c-7d355c49d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b7879a-a118-45dd-96fe-a89fe331465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Volume volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 (4a3aebc4-dc58-42d9-a80a-ce322efa1203): created successfully Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b7879a-a118-45dd-96fe-a89fe331465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Flow 'volume_create_manager' (3fcfa0b8-8a3a-4c0a-bcf0-e3a1363835df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a819d6b9-b034-4b9f-a928-3a1125de856f tempest-VolumesTransfersTest-1257215569 None] Created volume successfully. Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Flow 'volume_create_manager' (cb8c64a1-a47d-49c4-b46a-6248253f87a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662f1016-53a8-4efb-be25-f623689d2a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662f1016-53a8-4efb-be25-f623689d2a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-140597671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e755fc-1db0-43b8-bd67-119fd5223909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df37cce19df142acb913087ac2b9227c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cf782105-6278-4dbe-a568-fe10b0c24c26,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:26Z,use_quota=True,user_id='da6933d483944ff3a3ff91a1d21f0a9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60559500-ddc0-49eb-be32-c3598c983810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60559500-ddc0-49eb-be32-c3598c983810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b327734c-16aa-43e4-ae42-88cd3330577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b327734c-16aa-43e4-ae42-88cd3330577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '33e755fc-1db0-43b8-bd67-119fd5223909', 'volume_name': 'volume-33e755fc-1db0-43b8-bd67-119fd5223909', 'volume_size': 1, 'snapshot_id': 'cf782105-6278-4dbe-a568-fe10b0c24c26'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eeff993-4961-40e4-918c-b15c70d89f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eeff993-4961-40e4-918c-b15c70d89f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fa7c7d-5f5e-4101-895a-8cf2032eed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Volume 33e755fc-1db0-43b8-bd67-119fd5223909: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-33e755fc-1db0-43b8-bd67-119fd5223909', 'volume_size': 1, 'snapshot_id': 'cf782105-6278-4dbe-a568-fe10b0c24c26'} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-quobyte-cf782105-6278-4dbe-a568-fe10b0c24c26-33e755fc-1db0-43b8-bd67-119fd5223909" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-cf782105-6278-4dbe-a568-fe10b0c24c26-33e755fc-1db0-43b8-bd67-119fd5223909" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Creating volume 33e755fc-1db0-43b8-bd67-119fd5223909 from snapshot cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-quobyte-33e755fc-1db0-43b8-bd67-119fd5223909" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-33e755fc-1db0-43b8-bd67-119fd5223909" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] snapshot: cf782105-6278-4dbe-a568-fe10b0c24c26, volume: 33e755fc-1db0-43b8-bd67-119fd5223909, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2dfa19-950c-450f-825b-f1f73ef56a4f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:26 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 Aug 26 03:09:26 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:27 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26" returned: 0 in 0.689s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:09:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e72603d-3a8f-4a1a-93f0-5cd61dd61bc2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:27 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 Aug 26 03:09:27 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-761830de-2fe7-4a46-84c3-9e93745293ee tempest-VolumesTransfersTest-1880705424 None] Transfer volume completed successfully. Aug 26 03:09:28 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" returned: 0 in 0.661s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:28 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 Aug 26 03:09:28 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Acquiring lock "cinder-4a3aebc4-dc58-42d9-a80a-ce322efa1203-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-4a3aebc4-dc58-42d9-a80a-ce322efa1203-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Acquiring lock "cinder-quobyte-4a3aebc4-dc58-42d9-a80a-ce322efa1203" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-quobyte-4a3aebc4-dc58-42d9-a80a-ce322efa1203" acquired by "delete_volume" :: waited 0.061s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:29 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[238104e9-a456-493d-a62e-2430210300e3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:29 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 Aug 26 03:09:29 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:30 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203" returned: 0 in 1.142s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:30 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203 Aug 26 03:09:30 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:30 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a3aebc4-dc58-42d9-a80a-ce322efa1203" returned: 0 in 0.566s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-quobyte-4a3aebc4-dc58-42d9-a80a-ce322efa1203" released by "delete_volume" :: held 1.861s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:30 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Created reservations ['1bc25564-8f79-4b71-a551-20502dcebee4', '601f5542-68c5-4dd1-9667-7f8de01c85e8', 'd87a7811-e06e-4da8-bf60-09443f34311c', 'b8cf88af-b9c0-4282-80d8-4df76d6bb78e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:31 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:31 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:32 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.940s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:32 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Deleted volume successfully. Aug 26 03:09:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bce1cfe5-147d-43a8-a01e-aa62bf37930d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-4a3aebc4-dc58-42d9-a80a-ce322efa1203-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Flow 'volume_create_manager' (05c8b9f3-514b-4a29-a212-904507a34a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe44283-177c-4451-ae99-54b35d018547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe44283-177c-4451-ae99-54b35d018547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1111823283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090034d3-01e4-4b41-9fe1-ca9a575ddf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931543da033848f3b44f954166aafb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:33Z,use_quota=True,user_id='6a8010eab58a4141aa49c33c8e15a6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d0c365-a24c-47ed-bc2e-9a0689cb6baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d0c365-a24c-47ed-bc2e-9a0689cb6baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfd3e89-61eb-4bf4-8afc-05e442e8c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcfd3e89-61eb-4bf4-8afc-05e442e8c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090034d3-01e4-4b41-9fe1-ca9a575ddf48', 'volume_name': 'volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62f9be8-97fa-4f34-afc8-daf0eb1cd636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62f9be8-97fa-4f34-afc8-daf0eb1cd636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9232b790-5b52-49de-9966-df29d61092c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Volume 090034d3-01e4-4b41-9fe1-ca9a575ddf48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48', 'volume_size': 1} Aug 26 03:09:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:35 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909" returned: 0 in 6.947s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:09:35 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Converted 1024.00 MB image at 147.37 MB/s Aug 26 03:09:35 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 is being set with open permissions: ugo+rw Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:35 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 Aug 26 03:09:35 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:35 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909" returned: 0 in 0.308s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-33e755fc-1db0-43b8-bd67-119fd5223909" released by "_copy_volume_from_snapshot" :: held 8.735s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-cf782105-6278-4dbe-a568-fe10b0c24c26-33e755fc-1db0-43b8-bd67-119fd5223909" released by "_create_volume_from_snapshot" :: held 8.828s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.852s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.719s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1111823283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090034d3-01e4-4b41-9fe1-ca9a575ddf48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931543da033848f3b44f954166aafb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:33Z,use_quota=True,user_id='6a8010eab58a4141aa49c33c8e15a6ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Creating volume 090034d3-01e4-4b41-9fe1-ca9a575ddf48 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:35 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fa7c7d-5f5e-4101-895a-8cf2032eed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e755fc-1db0-43b8-bd67-119fd5223909', 'volume_size': 1, 'snapshot_id': 'cf782105-6278-4dbe-a568-fe10b0c24c26'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:35 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 1073741824 Aug 26 03:09:35 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bf0996-29cb-4b35-b1a3-9b4196f0f0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Volume volume-33e755fc-1db0-43b8-bd67-119fd5223909 (33e755fc-1db0-43b8-bd67-119fd5223909): created successfully Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bf0996-29cb-4b35-b1a3-9b4196f0f0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Flow 'volume_create_manager' (cb8c64a1-a47d-49c4-b46a-6248253f87a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3d1be870-48e5-4f28-8b03-13d93b3168f2 tempest-VolumeDependencyTests-1984183705 None] Created volume successfully. Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-cf782105-6278-4dbe-a568-fe10b0c24c26-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-cf782105-6278-4dbe-a568-fe10b0c24c26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-quobyte-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-quobyte-cf782105-6278-4dbe-a568-fe10b0c24c26" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-cf782105-6278-4dbe-a568-fe10b0c24c26" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Deleting offline snapshot cf782105-6278-4dbe-a568-fe10b0c24c26 of volume 4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:09:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] snapshot_file for this snap is: volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41cbfc2-cfc5-4626-833d-ade794ae1ed7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-985ccc94-e905-44fa-be65-072e7e8f5881 tempest-GroupSnapshotsV319Test-533974643 None] Group tempest-GroupSnapshotsV319Test-Group-529335181: creating Aug 26 03:09:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-985ccc94-e905-44fa-be65-072e7e8f5881 tempest-GroupSnapshotsV319Test-533974643 None] Group tempest-GroupSnapshotsV319Test-Group-529335181: created successfully Aug 26 03:09:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-985ccc94-e905-44fa-be65-072e7e8f5881 tempest-GroupSnapshotsV319Test-533974643 None] Create group completed successfully. Aug 26 03:09:36 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 Aug 26 03:09:36 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:36 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 1073741824" returned: 0 in 0.749s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:36 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 Aug 26 03:09:36 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:36 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26" returned: 0 in 0.443s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[61df8f8d-ff51-4bf2-855f-1ba6b7136e89]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:36 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9232b790-5b52-49de-9966-df29d61092c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c029b21c-b91f-41ee-b0b9-02b74575c2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Volume volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 (090034d3-01e4-4b41-9fe1-ca9a575ddf48): created successfully Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c029b21c-b91f-41ee-b0b9-02b74575c2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Flow 'volume_create_manager' (05c8b9f3-514b-4a29-a212-904507a34a18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6f2fa60c-e49f-44d7-a3cf-67780ee3104c tempest-VolumesTransfersTest-1257215569 None] Created volume successfully. Aug 26 03:09:36 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 Aug 26 03:09:36 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:37 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" returned: 0 in 0.607s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:37 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 Aug 26 03:09:37 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:37 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26" returned: 0 in 0.476s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:37 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26 Aug 26 03:09:37 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Flow 'volume_create_manager' (5daec126-92a0-44c2-9ed8-3b64a691210a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71df305-5acf-4d3a-8890-2ef1462ead73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71df305-5acf-4d3a-8890-2ef1462ead73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472204741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5031efb0-4757-4fa4-a387-a0671ec3dc84,host='devstack@QuobyteHD#QuobyteHD',id=d6ad6894-379a-4369-b0d9-d5b5337874b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c3f38a6d50493b819365ef6bcb610f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:38Z,use_quota=True,user_id='35744f0adb9d447681dff6fb0f62f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62ce57c5-3c4b-4ff3-84a7-9707052cd34d),volume_type_id=62ce57c5-3c4b-4ff3-84a7-9707052cd34d)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258ff0c3-99ad-4bea-896f-cbf5d76ad2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (258ff0c3-99ad-4bea-896f-cbf5d76ad2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164dc8d6-0951-4736-bee1-e1dabea6c229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164dc8d6-0951-4736-bee1-e1dabea6c229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6ad6894-379a-4369-b0d9-d5b5337874b6', 'volume_name': 'volume-d6ad6894-379a-4369-b0d9-d5b5337874b6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8581b0e3-5f86-4e78-82a6-af123d6989f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8581b0e3-5f86-4e78-82a6-af123d6989f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85c7579-e364-4525-9eaa-66fb860862cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Volume d6ad6894-379a-4369-b0d9-d5b5337874b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6ad6894-379a-4369-b0d9-d5b5337874b6', 'volume_size': 1} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5031efb0-4757-4fa4-a387-a0671ec3dc84,created_at=2026-08-26T01:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472204741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5031efb0-4757-4fa4-a387-a0671ec3dc84,host='devstack@QuobyteHD#QuobyteHD',id=d6ad6894-379a-4369-b0d9-d5b5337874b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71c3f38a6d50493b819365ef6bcb610f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:09:38Z,use_quota=True,user_id='35744f0adb9d447681dff6fb0f62f025',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62ce57c5-3c4b-4ff3-84a7-9707052cd34d),volume_type_id=62ce57c5-3c4b-4ff3-84a7-9707052cd34d)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Creating volume d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:09:37 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:09:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:37 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 1073741824 Aug 26 03:09:37 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:38 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3.cf782105-6278-4dbe-a568-fe10b0c24c26" returned: 0 in 0.429s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-cf782105-6278-4dbe-a568-fe10b0c24c26" released by "_delete_snapshot" :: held 2.148s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" released by "delete_snapshot" :: held 2.189s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Created reservations ['8aeaf45e-57b2-4332-8896-969e35e2be54', 'fd3c5b9a-c8a7-42f0-b3a5-985fdcee6494', '8b4deefd-a98a-4e33-ab27-b7fc83bddc84', 'de6105d6-519a-41b0-a9bd-a3d1cbc0f846'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Acquiring lock "cinder-090034d3-01e4-4b41-9fe1-ca9a575ddf48-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-090034d3-01e4-4b41-9fe1-ca9a575ddf48-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Delete snapshot completed successfully. Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-33daf11b-9e68-4671-987e-e4258ded3f95 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-cf782105-6278-4dbe-a568-fe10b0c24c26-delete_snapshot" released by "delete_snapshot" :: held 2.438s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Acquiring lock "cinder-quobyte-090034d3-01e4-4b41-9fe1-ca9a575ddf48" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-quobyte-090034d3-01e4-4b41-9fe1-ca9a575ddf48" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8579fdfb-f169-49cb-9d66-d5d0b1546bd3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:38 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 Aug 26 03:09:38 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:38 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 1073741824" returned: 0 in 0.666s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:38 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 Aug 26 03:09:38 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:38 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48" returned: 0 in 0.500s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:38 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48 Aug 26 03:09:38 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:38 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6" returned: 0 in 0.325s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:09:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85c7579-e364-4525-9eaa-66fb860862cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6ad6894-379a-4369-b0d9-d5b5337874b6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a255f1d6-7cfc-42a7-b381-36ff43260363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:09:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Volume volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 (d6ad6894-379a-4369-b0d9-d5b5337874b6): created successfully Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a255f1d6-7cfc-42a7-b381-36ff43260363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Flow 'volume_create_manager' (5daec126-92a0-44c2-9ed8-3b64a691210a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:09:39 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5397454e-4b28-45cf-91b4-f0732e5f5e16 tempest-GroupSnapshotsV319Test-533974643 None] Created volume successfully. Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-quobyte-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:39 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-090034d3-01e4-4b41-9fe1-ca9a575ddf48" returned: 0 in 0.398s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-quobyte-090034d3-01e4-4b41-9fe1-ca9a575ddf48" released by "delete_volume" :: held 0.939s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e2fd32-f00c-4bf4-a744-bc7956aff43b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Created reservations ['0cc17f8e-3939-4638-9f26-f1b5c3c0a3f5', '5179f3d2-2c58-40d1-9ca0-d12ac5e7045a', '91809765-2058-493f-982d-7cd3d0fd14af', 'f459354c-e911-4b15-a313-65d23abd0a78'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:39 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 Aug 26 03:09:39 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:39 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:39 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:39 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" returned: 0 in 0.462s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:39 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.294s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:39 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Deleted volume successfully. Aug 26 03:09:39 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3 Aug 26 03:09:39 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7934871f-d723-474b-8f5e-5164835a376d tempest-VolumesTransfersTest-862235037 None] Lock "cinder-090034d3-01e4-4b41-9fe1-ca9a575ddf48-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:40 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" returned: 0 in 0.325s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3" released by "delete_volume" :: held 0.866s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Created reservations ['df0bc7fc-7516-4205-8c2f-a8553ae5ec19', '08b37b7f-63ea-442f-abb9-d582d4071419', '90828c10-ab46-405b-9e18-670c47b86549', 'df887d29-b3d6-4afa-acd4-337461c967be'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:40 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:40 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-33e755fc-1db0-43b8-bd67-119fd5223909-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-33e755fc-1db0-43b8-bd67-119fd5223909-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "cinder-quobyte-33e755fc-1db0-43b8-bd67-119fd5223909" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-33e755fc-1db0-43b8-bd67-119fd5223909" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db15266-e0d4-4097-a03a-e62001997f05]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] GroupSnapshot c545f7cc-0253-457e-ab8c-469bbf58997e: creating. Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Group snapshot c545f7cc-0253-457e-ab8c-469bbf58997e: creating. {{(pid=94506) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Creating offline snapshot 95c5c364-85ad-4c63-a889-e52a7458ec16 of volume d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[efec7e47-441c-4879-863c-9193a8bd5d77]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:40 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 Aug 26 03:09:40 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:40 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.497s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Deleted volume successfully. Aug 26 03:09:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ee6639aa-a2e4-4b52-853c-0bc5dbab1962 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-4de4d8b6-ddab-4b89-a6fa-708dd2c76ba3-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:40 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 Aug 26 03:09:40 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:41 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909" returned: 0 in 0.617s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:41 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909 Aug 26 03:09:41 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:41 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6" returned: 0 in 0.610s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:41 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 1G Aug 26 03:09:41 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:41 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-33e755fc-1db0-43b8-bd67-119fd5223909" returned: 0 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-quobyte-33e755fc-1db0-43b8-bd67-119fd5223909" released by "delete_volume" :: held 1.018s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Created reservations ['fe770acc-482a-4cbf-ba0c-3fb578e33009', '5e013955-0ed1-43ce-a521-bcc2134359fc', '7dfa93db-9e5a-49d1-b564-37be66c9c910', '42be95b6-1518-49bd-8c6d-2717f2a2e159'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:41 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:41 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:42 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 1G" returned: 0 in 0.732s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:42 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.342s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Deleted volume successfully. Aug 26 03:09:42 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 Aug 26 03:09:42 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52dd7fbc-b456-4e4b-9239-0da2c4f56af9 tempest-VolumeDependencyTests-1984183705 None] Lock "cinder-33e755fc-1db0-43b8-bd67-119fd5223909-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:42 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16" returned: 0 in 0.392s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:42 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:42 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 Aug 26 03:09:42 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:42 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16" returned: 0 in 0.319s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:42 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info Aug 26 03:09:42 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:43 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info" returned: 0 in 0.338s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:43 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 26 03:09:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:43 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info Aug 26 03:09:43 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:43 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.info" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.921s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-256ba450-8a6f-438c-a417-f9c4ed0b9d5d tempest-GroupSnapshotsV319Test-533974643 None] group_snapshot c545f7cc-0253-457e-ab8c-469bbf58997e: created successfully Aug 26 03:09:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] group_snapshot c545f7cc-0253-457e-ab8c-469bbf58997e: deleting Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] group_snapshot c545f7cc-0253-457e-ab8c-469bbf58997e: deleting {{(pid=94506) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "cinder-quobyte-d6ad6894-379a-4369-b0d9-d5b5337874b6" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Lock "cinder-quobyte-d6ad6894-379a-4369-b0d9-d5b5337874b6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "cinder-quobyte-95c5c364-85ad-4c63-a889-e52a7458ec16" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Lock "cinder-quobyte-95c5c364-85ad-4c63-a889-e52a7458ec16" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Deleting offline snapshot 95c5c364-85ad-4c63-a889-e52a7458ec16 of volume d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] snapshot_file for this snap is: volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fc2de1-79d2-4e8e-a0e8-a861041db1aa]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:44 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 Aug 26 03:09:44 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:45 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16" returned: 0 in 0.663s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6ad6894-379a-4369-b0d9-d5b5337874b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:09:45 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36571bb-810d-48bb-953d-f3d54aeca472]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:45 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 Aug 26 03:09:45 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:45 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6" returned: 0 in 0.584s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:45 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 Aug 26 03:09:45 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:46 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16" returned: 0 in 0.545s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:46 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16 Aug 26 03:09:46 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:46 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6.95c5c364-85ad-4c63-a889-e52a7458ec16" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Lock "cinder-quobyte-95c5c364-85ad-4c63-a889-e52a7458ec16" released by "_delete_snapshot" :: held 2.360s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Lock "cinder-quobyte-d6ad6894-379a-4369-b0d9-d5b5337874b6" released by "delete_snapshot" :: held 2.407s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=123,cinder:UPDATE=184,cinder:INSERT=41,cinder:DELETE=16 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:09:46 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=142,cinder:UPDATE=183,cinder:INSERT=44,cinder:DELETE=16 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:09:47 devstack cinder-volume[94506]: WARNING cinder.quota [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1732110007 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1732110007, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:09:47 devstack cinder-volume[94506]: WARNING cinder.quota [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1732110007 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1732110007, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:09:47 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] Created reservations ['fff85635-9067-4155-b2a3-d77620b4d792', 'b10cbe8e-8044-46d4-9209-8a922ce65eb7', 'db61c18b-b90c-46be-85ff-7378521296bf', '63cb8d1d-5263-48a3-836b-5988870fb7c8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-28a65cdc-09e7-4414-98cf-3df739c15cc4 tempest-GroupSnapshotsV319Test-533974643 None] group_snapshot c545f7cc-0253-457e-ab8c-469bbf58997e: deleted successfully Aug 26 03:09:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "cinder-quobyte-d6ad6894-379a-4369-b0d9-d5b5337874b6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:09:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Lock "cinder-quobyte-d6ad6894-379a-4369-b0d9-d5b5337874b6" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:09:48 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77728bb-c268-4e0e-95a7-c4a03cd65a41]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:09:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:48 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 Aug 26 03:09:48 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:49 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6" returned: 0 in 0.612s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:49 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6 Aug 26 03:09:49 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:49 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d6ad6894-379a-4369-b0d9-d5b5337874b6" returned: 0 in 0.411s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Lock "cinder-quobyte-d6ad6894-379a-4369-b0d9-d5b5337874b6" released by "delete_volume" :: held 1.125s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Created reservations ['cc55c240-5757-4748-96ea-5e24d5b71071'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:49 devstack cinder-volume[94506]: WARNING cinder.quota [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1732110007 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1732110007, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Created reservations ['0f5e49b7-3ede-4953-bbb8-ca425669c2e7', '2592f176-1b3b-4bde-b549-a69035704858', 'b28544ba-b654-4f2b-9aa4-ba008c6d2443', '3e878dc7-e5c6-48f3-897b-a14433b3bdc9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:09:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:09:49 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:09:49 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:09:50 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Aug 26 03:09:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.511s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:09:50 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:09:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a3525c9b-1850-4224-9d27-c324e11d9c21 tempest-GroupSnapshotsV319Test-533974643 None] Delete group completed successfully. Aug 26 03:09:59 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=10,cinder:INSERT=5,cinder:UPDATE=19 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:09:59 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=14 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:10:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-79def75d-4861-4166-bf09-9f25c18cf0fa tempest-GroupsV320Test-1955902724 None] Group tempest-GroupsV320Test-Group-498383708: creating Aug 26 03:10:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-79def75d-4861-4166-bf09-9f25c18cf0fa tempest-GroupsV320Test-1955902724 None] Group tempest-GroupsV320Test-Group-498383708: created successfully Aug 26 03:10:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-79def75d-4861-4166-bf09-9f25c18cf0fa tempest-GroupsV320Test-1955902724 None] Create group completed successfully. Aug 26 03:10:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Created reservations ['97c2dc0c-935e-4cd7-b350-cc5dd2674379'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:03 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:10:03 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:03 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.304s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:03 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d1c34579-520a-4142-94ab-6a5cc08a45ea tempest-GroupsV320Test-1955902724 None] Delete group completed successfully. Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Flow 'volume_create_manager' (69056685-2ca6-4d2e-a60f-533051be2896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ad6a29-a6ab-4932-a31c-1a88c3f2d1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18ad6a29-a6ab-4932-a31c-1a88c3f2d1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787120787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78587041-049f-4ae8-ac02-37df17a8ac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9363fad09ce440ec905037cf3cf2024a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:09Z,use_quota=True,user_id='d8c9aaaeb83a4183b23b01e6af2a3841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e80db19-3e3d-4029-a36f-d3a87c7793ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e80db19-3e3d-4029-a36f-d3a87c7793ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ce181e-3050-4053-b855-f17472720543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ce181e-3050-4053-b855-f17472720543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78587041-049f-4ae8-ac02-37df17a8ac72', 'volume_name': 'volume-78587041-049f-4ae8-ac02-37df17a8ac72', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adf41ba-212a-445d-bf46-ce102bb6e8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5adf41ba-212a-445d-bf46-ce102bb6e8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5898f146-05d3-43f1-9c33-26306b964270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:08 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Volume 78587041-049f-4ae8-ac02-37df17a8ac72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78587041-049f-4ae8-ac02-37df17a8ac72', 'volume_size': 1} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787120787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78587041-049f-4ae8-ac02-37df17a8ac72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9363fad09ce440ec905037cf3cf2024a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:09Z,use_quota=True,user_id='d8c9aaaeb83a4183b23b01e6af2a3841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Creating volume 78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:08 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:10:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:08 devstack sudo[108423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 1073741824 Aug 26 03:10:08 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:09 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 1073741824" returned: 0 in 0.651s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:09 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:10:09 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:09 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.285s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5898f146-05d3-43f1-9c33-26306b964270) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78587041-049f-4ae8-ac02-37df17a8ac72', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c8c4a7-4833-4200-9d3c-c1aaa5a0f59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:09 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Volume volume-78587041-049f-4ae8-ac02-37df17a8ac72 (78587041-049f-4ae8-ac02-37df17a8ac72): created successfully Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c8c4a7-4833-4200-9d3c-c1aaa5a0f59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Flow 'volume_create_manager' (69056685-2ca6-4d2e-a60f-533051be2896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c38f55a0-dc76-4d57-bcfe-42975aa17547 tempest-VolumesActionsTest-667907144 None] Created volume successfully. Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Flow 'volume_create_manager' (460e3b77-2305-435e-8df6-a938c1c2b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773fa222-f3fd-4ee5-a0a4-070a98bbfeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773fa222-f3fd-4ee5-a0a4-070a98bbfeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1389620934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f7edb6-04d7-4bd8-8f72-d181806a3fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2470582b21be45a98f82d01302a95c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:20Z,use_quota=True,user_id='79867729f5da4f989e30de4a10edb66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382c8f78-6247-40c8-8905-938831bebce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382c8f78-6247-40c8-8905-938831bebce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842e1694-a1a9-4c1f-bcf1-b3636d1132d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842e1694-a1a9-4c1f-bcf1-b3636d1132d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f7edb6-04d7-4bd8-8f72-d181806a3fc4', 'volume_name': 'volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328fc0a1-a16e-4239-bf7a-39ec2974fabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328fc0a1-a16e-4239-bf7a-39ec2974fabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0a75ea-6e84-42d0-87d5-28bfa14e2cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Volume 27f7edb6-04d7-4bd8-8f72-d181806a3fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4', 'volume_size': 1} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1389620934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f7edb6-04d7-4bd8-8f72-d181806a3fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2470582b21be45a98f82d01302a95c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:20Z,use_quota=True,user_id='79867729f5da4f989e30de4a10edb66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Creating volume 27f7edb6-04d7-4bd8-8f72-d181806a3fc4 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:19 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:10:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:19 devstack sudo[108461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 1073741824 Aug 26 03:10:19 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Flow 'volume_create_manager' (e3f93902-b40b-4ac3-9f12-0f53b0ae6ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50835fe6-2872-4bbe-9696-ebe04940d67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50835fe6-2872-4bbe-9696-ebe04940d67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1974326435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16da00c6-abc9-4833-a9be-abe7a5ce86c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2470582b21be45a98f82d01302a95c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:20Z,use_quota=True,user_id='79867729f5da4f989e30de4a10edb66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff0d58a-c815-4bbd-a5e3-8ec71a8ce6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff0d58a-c815-4bbd-a5e3-8ec71a8ce6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd536ca-c25c-4edc-83f1-15175162bf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bd536ca-c25c-4edc-83f1-15175162bf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16da00c6-abc9-4833-a9be-abe7a5ce86c3', 'volume_name': 'volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4d120c-14bb-44d6-a95c-1bb280ab4683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4d120c-14bb-44d6-a95c-1bb280ab4683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3544467-cc53-4d53-974c-27d0f1bba26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Volume 16da00c6-abc9-4833-a9be-abe7a5ce86c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3', 'volume_size': 1} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:20 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 1073741824" returned: 0 in 0.808s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:20 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 Aug 26 03:10:20 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:21 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4" returned: 0 in 0.397s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1974326435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16da00c6-abc9-4833-a9be-abe7a5ce86c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2470582b21be45a98f82d01302a95c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:20Z,use_quota=True,user_id='79867729f5da4f989e30de4a10edb66f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Creating volume 16da00c6-abc9-4833-a9be-abe7a5ce86c3 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:21 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0a75ea-6e84-42d0-87d5-28bfa14e2cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:21 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 1073741824 Aug 26 03:10:21 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6899479e-d68f-4665-aee8-2778ca7c4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Volume volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 (27f7edb6-04d7-4bd8-8f72-d181806a3fc4): created successfully Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6899479e-d68f-4665-aee8-2778ca7c4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Flow 'volume_create_manager' (460e3b77-2305-435e-8df6-a938c1c2b418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7302fffc-6e35-4932-98ba-e52390296ac0 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Created volume successfully. Aug 26 03:10:22 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 1073741824" returned: 0 in 0.775s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:22 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 Aug 26 03:10:22 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:22 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3" returned: 0 in 0.285s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3544467-cc53-4d53-974c-27d0f1bba26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552c983d-705e-401f-abfd-dad5c7cd7dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:22 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Volume volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 (16da00c6-abc9-4833-a9be-abe7a5ce86c3): created successfully Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552c983d-705e-401f-abfd-dad5c7cd7dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Flow 'volume_create_manager' (e3f93902-b40b-4ac3-9f12-0f53b0ae6ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4ceac226-15ba-4a3e-9ef2-63d25f652df5 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Created volume successfully. Aug 26 03:10:32 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=13,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:10:32 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=13,cinder:UPDATE=12,cinder:INSERT=4,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:10:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7108c828-6ca7-4119-91a3-9aaa5c8b3b41 tempest-VolumesActionsTest-667907144 None] Acquiring lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72" by "attach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7108c828-6ca7-4119-91a3-9aaa5c8b3b41 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72" acquired by "attach_volume" :: waited 0.072s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7108c828-6ca7-4119-91a3-9aaa5c8b3b41 tempest-VolumesActionsTest-667907144 None] Attaching volume 78587041-049f-4ae8-ac02-37df17a8ac72 to instance 64b0c44a-26c7-4ad8-b0b9-be89d7a89954 at mountpoint /dev/vdb on host None. Aug 26 03:10:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7108c828-6ca7-4119-91a3-9aaa5c8b3b41 tempest-VolumesActionsTest-667907144 None] Attach volume completed successfully. Aug 26 03:10:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7108c828-6ca7-4119-91a3-9aaa5c8b3b41 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72" released by "attach_volume" :: held 0.282s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90d89d90-a5b7-4ec6-9a06-d6afe81955e1 tempest-VolumesActionsTest-667907144 None] Acquiring lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-detach_volume" by "detach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90d89d90-a5b7-4ec6-9a06-d6afe81955e1 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-90d89d90-a5b7-4ec6-9a06-d6afe81955e1 tempest-VolumesActionsTest-667907144 None] Detaching volume 78587041-049f-4ae8-ac02-37df17a8ac72 from instance 64b0c44a-26c7-4ad8-b0b9-be89d7a89954. Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Flow 'volume_create_manager' (b70ae6da-462a-4efa-8697-77d6c266c5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aeb503-b58a-46e5-9208-7aa9ed2c393e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20aeb503-b58a-46e5-9208-7aa9ed2c393e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-369650247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ae33ee-b7ee-4767-8293-1a7031dc3c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23cc4ed52744f2e9d040ff0c3c38b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:36Z,use_quota=True,user_id='0413d1e0147b4317be0ac9393cae5c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4b0f41-c1e0-43f4-a66e-5d27987980c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4b0f41-c1e0-43f4-a66e-5d27987980c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547a817e-a62c-4e83-b9b4-2013d9dd57d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547a817e-a62c-4e83-b9b4-2013d9dd57d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ae33ee-b7ee-4767-8293-1a7031dc3c09', 'volume_name': 'volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dfc5d5-dc8b-42f7-9230-2fb2316594f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6dfc5d5-dc8b-42f7-9230-2fb2316594f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933a47de-6238-4875-bbc1-091a77dbce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Volume 41ae33ee-b7ee-4767-8293-1a7031dc3c09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09', 'volume_size': 1} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-369650247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ae33ee-b7ee-4767-8293-1a7031dc3c09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23cc4ed52744f2e9d040ff0c3c38b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:36Z,use_quota=True,user_id='0413d1e0147b4317be0ac9393cae5c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Creating volume 41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:36 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:36 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 1073741824 Aug 26 03:10:36 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-90d89d90-a5b7-4ec6-9a06-d6afe81955e1 tempest-VolumesActionsTest-667907144 None] Detach volume completed successfully. Aug 26 03:10:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90d89d90-a5b7-4ec6-9a06-d6afe81955e1 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-detach_volume" released by "detach_volume" :: held 0.401s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:37 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 1073741824" returned: 0 in 0.862s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:37 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 Aug 26 03:10:37 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:37 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09" returned: 0 in 0.439s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (933a47de-6238-4875-bbc1-091a77dbce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b38efe-dcbc-4b52-acdd-1009bbc91f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Volume volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 (41ae33ee-b7ee-4767-8293-1a7031dc3c09): created successfully Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b38efe-dcbc-4b52-acdd-1009bbc91f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Flow 'volume_create_manager' (b70ae6da-462a-4efa-8697-77d6c266c5c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b98ad497-922f-40fc-9fc4-dd2ebc9c7c80 tempest-SnapshotDependencyTests-1547620755 None] Created volume successfully. Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Creating offline snapshot 36597b28-8d19-4de3-b3af-fdb6638d5eee of volume 41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[afecb5c9-dd3c-41c4-9581-5ba410a7da2b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:38 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 Aug 26 03:10:38 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:38 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09" returned: 0 in 0.525s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:38 devstack sudo[108663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee 1G Aug 26 03:10:38 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:39 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee 1G" returned: 0 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:39 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee Aug 26 03:10:39 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:39 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee" returned: 0 in 0.494s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:39 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee is being set with open permissions: ugo+rw Aug 26 03:10:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:39 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee Aug 26 03:10:39 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:40 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee" returned: 0 in 0.356s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:40 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info Aug 26 03:10:40 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:40 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info" returned: 0 in 0.534s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:40 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info is being set with open permissions: ugo+rw Aug 26 03:10:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:40 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info Aug 26 03:10:40 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:41 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.info" returned: 0 in 0.537s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.111s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0fec789b-9eb5-487f-8385-d54173311769 tempest-SnapshotDependencyTests-1547620755 None] Create snapshot completed successfully Aug 26 03:10:43 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Flow 'volume_create_manager' (766f1328-a182-4c8d-b937-78dbdf13898d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e0e89a-e45c-49d6-8143-5cc1e336d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21e0e89a-e45c-49d6-8143-5cc1e336d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcdf9cf-2281-4af7-9e61-6e1daa9530be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23cc4ed52744f2e9d040ff0c3c38b67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=36597b28-8d19-4de3-b3af-fdb6638d5eee,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:44Z,use_quota=True,user_id='0413d1e0147b4317be0ac9393cae5c5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b88b15-4156-4f2c-85d1-4bda933df968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5b88b15-4156-4f2c-85d1-4bda933df968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0fe9f8-b2f5-4adc-8ba9-abf4ebf0fb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0fe9f8-b2f5-4adc-8ba9-abf4ebf0fb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'efcdf9cf-2281-4af7-9e61-6e1daa9530be', 'volume_name': 'volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be', 'volume_size': 1, 'snapshot_id': '36597b28-8d19-4de3-b3af-fdb6638d5eee'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce8ba5c-6b3d-430e-81e0-21021a84906d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ce8ba5c-6b3d-430e-81e0-21021a84906d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83a7ec6-604b-4ee9-936b-b2a49210f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:44 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Volume efcdf9cf-2281-4af7-9e61-6e1daa9530be: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be', 'volume_size': 1, 'snapshot_id': '36597b28-8d19-4de3-b3af-fdb6638d5eee'} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-quobyte-36597b28-8d19-4de3-b3af-fdb6638d5eee-efcdf9cf-2281-4af7-9e61-6e1daa9530be" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-36597b28-8d19-4de3-b3af-fdb6638d5eee-efcdf9cf-2281-4af7-9e61-6e1daa9530be" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Creating volume efcdf9cf-2281-4af7-9e61-6e1daa9530be from snapshot 36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-quobyte-efcdf9cf-2281-4af7-9e61-6e1daa9530be" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-efcdf9cf-2281-4af7-9e61-6e1daa9530be" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] snapshot: 36597b28-8d19-4de3-b3af-fdb6638d5eee, volume: efcdf9cf-2281-4af7-9e61-6e1daa9530be, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0fd0a9-27f3-4652-844e-11276e3a428c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:44 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee Aug 26 03:10:44 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:45 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee" returned: 0 in 0.977s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[28177a4b-322f-4351-9fe8-284e6f2d3cc3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:45 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 Aug 26 03:10:45 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Flow 'volume_create_manager' (74761c6e-6ce6-45d4-bba3-87ae694f7c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee359ce-b4a1-4363-b3ca-6cb6370f6bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ee359ce-b4a1-4363-b3ca-6cb6370f6bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1931789563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee17d38b-7fa0-4a51-abba-998c6c55fd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9be78875904cc7a25037f35cce69eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:46Z,use_quota=True,user_id='b156cfa549094b6ea46453fc79bb67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a137a2dc-f229-41c2-8769-c3cb203e3977),volume_type_id=a137a2dc-f229-41c2-8769-c3cb203e3977)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3230ce93-9e6b-482a-9786-12fb62b291a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3230ce93-9e6b-482a-9786-12fb62b291a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc65636-b85e-4319-aecd-5ca243729f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fc65636-b85e-4319-aecd-5ca243729f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee17d38b-7fa0-4a51-abba-998c6c55fd4c', 'volume_name': 'volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d23d6b7-5b20-4276-8a11-7844774ed204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d23d6b7-5b20-4276-8a11-7844774ed204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3f16e5-c994-4d0c-a33f-d401b78ecc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Volume ee17d38b-7fa0-4a51-abba-998c6c55fd4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c', 'volume_size': 1} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:46 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09" returned: 0 in 0.727s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:10:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:46 devstack sudo[108793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be Aug 26 03:10:46 devstack sudo[108793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:53 devstack sudo[108793]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be" returned: 0 in 7.232s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:53 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09, size 1024.00 MB, duration 7.23 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:10:53 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Converted 1024.00 MB image at 141.56 MB/s Aug 26 03:10:53 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be is being set with open permissions: ugo+rw Aug 26 03:10:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:53 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be Aug 26 03:10:53 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:53 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be" returned: 0 in 0.526s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-efcdf9cf-2281-4af7-9e61-6e1daa9530be" released by "_copy_volume_from_snapshot" :: held 9.639s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-36597b28-8d19-4de3-b3af-fdb6638d5eee-efcdf9cf-2281-4af7-9e61-6e1daa9530be" released by "_create_volume_from_snapshot" :: held 9.760s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.789s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.969s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1931789563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee17d38b-7fa0-4a51-abba-998c6c55fd4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b9be78875904cc7a25037f35cce69eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:10:46Z,use_quota=True,user_id='b156cfa549094b6ea46453fc79bb67be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a137a2dc-f229-41c2-8769-c3cb203e3977),volume_type_id=a137a2dc-f229-41c2-8769-c3cb203e3977)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Creating volume ee17d38b-7fa0-4a51-abba-998c6c55fd4c {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:10:54 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83a7ec6-604b-4ee9-936b-b2a49210f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be', 'volume_size': 1, 'snapshot_id': '36597b28-8d19-4de3-b3af-fdb6638d5eee'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21631e77-4764-4920-96e5-f8b5c0a94d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:54 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c 1073741824 Aug 26 03:10:54 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:54 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Volume volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be (efcdf9cf-2281-4af7-9e61-6e1daa9530be): created successfully Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21631e77-4764-4920-96e5-f8b5c0a94d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Flow 'volume_create_manager' (766f1328-a182-4c8d-b937-78dbdf13898d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ebc6c8f4-fc85-4b24-a2e3-aa426adcdd2f tempest-SnapshotDependencyTests-1547620755 None] Created volume successfully. Aug 26 03:10:55 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c 1073741824" returned: 0 in 1.187s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:55 devstack sudo[108889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c Aug 26 03:10:55 devstack sudo[108889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-36597b28-8d19-4de3-b3af-fdb6638d5eee-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-36597b28-8d19-4de3-b3af-fdb6638d5eee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-quobyte-41ae33ee-b7ee-4767-8293-1a7031dc3c09" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-41ae33ee-b7ee-4767-8293-1a7031dc3c09" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-quobyte-36597b28-8d19-4de3-b3af-fdb6638d5eee" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-36597b28-8d19-4de3-b3af-fdb6638d5eee" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Deleting offline snapshot 36597b28-8d19-4de3-b3af-fdb6638d5eee of volume 41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] snapshot_file for this snap is: volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d9941cb-d014-4163-835c-d9a2f2632eda]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:55 devstack sudo[108889]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a3f16e5-c994-4d0c-a33f-d401b78ecc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cab9e7a-b4f9-4b3d-bbe3-a515d377e82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:10:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Volume volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c (ee17d38b-7fa0-4a51-abba-998c6c55fd4c): created successfully Aug 26 03:10:55 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee Aug 26 03:10:55 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cab9e7a-b4f9-4b3d-bbe3-a515d377e82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:10:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Flow 'volume_create_manager' (74761c6e-6ce6-45d4-bba3-87ae694f7c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:10:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-948f9080-c06d-4988-8499-4814693f02e8 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Created volume successfully. Aug 26 03:10:56 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee" returned: 0 in 0.644s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[132b55f2-b278-4371-8609-ea08a7f0145a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:56 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 Aug 26 03:10:56 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:56 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:10:56 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:57 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.361s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:57 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:10:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-360bb745-52d0-4fe0-87e2-89f9134499bd tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Retype volume completed successfully. Aug 26 03:10:57 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09" returned: 0 in 0.964s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:57 devstack sudo[108942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee Aug 26 03:10:57 devstack sudo[108942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:57 devstack sudo[108942]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:57 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee Aug 26 03:10:57 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:58 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09.36597b28-8d19-4de3-b3af-fdb6638d5eee" returned: 0 in 0.314s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-36597b28-8d19-4de3-b3af-fdb6638d5eee" released by "_delete_snapshot" :: held 2.498s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-41ae33ee-b7ee-4767-8293-1a7031dc3c09" released by "delete_snapshot" :: held 2.536s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Acquiring lock "cinder-ee17d38b-7fa0-4a51-abba-998c6c55fd4c-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "cinder-ee17d38b-7fa0-4a51-abba-998c6c55fd4c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Created reservations ['b44a35bf-06ed-4c0b-b2c5-ef2c9786cfd6', '3c61082f-6e0a-4f06-89bc-fadcf760c9af', '5332b7e4-6c72-47da-a85e-a4d6c19ccb47', '037ea0a5-14ff-4689-8804-b916ae4d8f39'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Acquiring lock "cinder-quobyte-ee17d38b-7fa0-4a51-abba-998c6c55fd4c" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "cinder-quobyte-ee17d38b-7fa0-4a51-abba-998c6c55fd4c" acquired by "delete_volume" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Delete snapshot completed successfully. Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce262e-690a-4c54-9d0e-79cefc450698]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fcaea66a-2cff-4b60-9822-715b5bfbe525 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-36597b28-8d19-4de3-b3af-fdb6638d5eee-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:58 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c Aug 26 03:10:58 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:58 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-41ae33ee-b7ee-4767-8293-1a7031dc3c09-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c" returned: 0 in 0.471s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-41ae33ee-b7ee-4767-8293-1a7031dc3c09-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:58 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c Aug 26 03:10:58 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-quobyte-41ae33ee-b7ee-4767-8293-1a7031dc3c09" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-41ae33ee-b7ee-4767-8293-1a7031dc3c09" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24e7c41d-3b96-495b-be28-0b5bd0527738 tempest-VolumesActionsTest-667907144 None] Acquiring lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72" by "attach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b77f65-a5b9-4e2c-ae44-f3e5c0b14de8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24e7c41d-3b96-495b-be28-0b5bd0527738 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72" acquired by "attach_volume" :: waited 0.043s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-24e7c41d-3b96-495b-be28-0b5bd0527738 tempest-VolumesActionsTest-667907144 None] Attaching volume 78587041-049f-4ae8-ac02-37df17a8ac72 to instance ae3066af-abca-4918-bbbf-b3548b4aca9b at mountpoint /dev/vdb on host None. Aug 26 03:10:59 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 Aug 26 03:10:59 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-24e7c41d-3b96-495b-be28-0b5bd0527738 tempest-VolumesActionsTest-667907144 None] Attach volume completed successfully. Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24e7c41d-3b96-495b-be28-0b5bd0527738 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72" released by "attach_volume" :: held 0.137s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:59 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ee17d38b-7fa0-4a51-abba-998c6c55fd4c" returned: 0 in 0.504s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "cinder-quobyte-ee17d38b-7fa0-4a51-abba-998c6c55fd4c" released by "delete_volume" :: held 1.047s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:59 devstack cinder-volume[94506]: WARNING cinder.quota [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:10:59 devstack cinder-volume[94506]: WARNING cinder.quota [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Created reservations ['ebf36952-6895-4da9-b5cd-de34408c6776', '21452693-1914-4494-a980-0abc9d9725cc', '3cce70de-57c8-4e0a-aa79-de663226ece4', '96efacf2-1342-4acf-baee-c8a954931add'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b80f8b3c-59c7-4de8-abf6-49a7d2ab1b4c tempest-VolumesActionsTest-667907144 None] Acquiring lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-detach_volume" by "detach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b80f8b3c-59c7-4de8-abf6-49a7d2ab1b4c tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:10:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b80f8b3c-59c7-4de8-abf6-49a7d2ab1b4c tempest-VolumesActionsTest-667907144 None] Detaching volume 78587041-049f-4ae8-ac02-37df17a8ac72 from instance ae3066af-abca-4918-bbbf-b3548b4aca9b. Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:59 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09" returned: 0 in 0.639s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:10:59 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:10:59 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:59 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09 Aug 26 03:10:59 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:10:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b80f8b3c-59c7-4de8-abf6-49a7d2ab1b4c tempest-VolumesActionsTest-667907144 None] Detach volume completed successfully. Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b80f8b3c-59c7-4de8-abf6-49a7d2ab1b4c tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-detach_volume" released by "detach_volume" :: held 0.149s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:10:59 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Aug 26 03:10:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-41ae33ee-b7ee-4767-8293-1a7031dc3c09" returned: 0 in 0.285s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-41ae33ee-b7ee-4767-8293-1a7031dc3c09" released by "delete_volume" :: held 1.031s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:00 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.417s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Deleted volume successfully. Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f155f776-7a79-4b02-838b-c0cfbfadcab5 tempest-VolumeRetypeWithoutMigrationTest-1165016488 None] Lock "cinder-ee17d38b-7fa0-4a51-abba-998c6c55fd4c-delete_volume" released by "delete_volume" :: held 1.876s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Created reservations ['5bb5d2eb-a3ca-4a28-af4f-7a3ba82daeb7', '9807523a-c739-43c3-8d0a-bb45c5fb67a4', '50ca1ca9-a5ed-4b82-a9d0-df6d114e477a', 'f69c544f-021a-467a-9446-96615acb8d3e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:00 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:11:00 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:00 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.259s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Deleted volume successfully. Aug 26 03:11:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-362b715b-a85f-4d00-9c21-d257aea46b63 tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-41ae33ee-b7ee-4767-8293-1a7031dc3c09-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-efcdf9cf-2281-4af7-9e61-6e1daa9530be-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-efcdf9cf-2281-4af7-9e61-6e1daa9530be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "cinder-quobyte-efcdf9cf-2281-4af7-9e61-6e1daa9530be" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-efcdf9cf-2281-4af7-9e61-6e1daa9530be" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf048cb-5ec6-4cb7-aeeb-d02e3e670c42]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:01 devstack sudo[108996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be Aug 26 03:11:01 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:01 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be" returned: 0 in 0.633s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:02 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be Aug 26 03:11:02 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:02 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-efcdf9cf-2281-4af7-9e61-6e1daa9530be" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-quobyte-efcdf9cf-2281-4af7-9e61-6e1daa9530be" released by "delete_volume" :: held 1.041s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Created reservations ['7e995c01-b3f0-46cd-9265-3372eba31e00', 'e5ba3a4f-fd72-41ae-8530-32b47733329a', '694f77d5-4daf-46f0-8646-7367222fcc33', '999661f8-2ccf-4b6b-885f-95a204051c60'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:02 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:11:02 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:02 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.287s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Deleted volume successfully. Aug 26 03:11:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52d7ece6-bc12-4754-bdc2-c954ec6648ce tempest-SnapshotDependencyTests-1547620755 None] Lock "cinder-efcdf9cf-2281-4af7-9e61-6e1daa9530be-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[741288ed-ff37-455a-9055-ad73e28f4a7c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:06 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:06 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:06 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[83240c7b-b68f-4164-95eb-d340768d0f07]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:06 devstack sudo[109017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:06 devstack sudo[109017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:07 devstack sudo[109017]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.435s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.c95a25e5-16fa-4231-beac-20b6dfc6a7892klhnk8e.img {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:07 devstack sudo[109022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.c95a25e5-16fa-4231-beac-20b6dfc6a7892klhnk8e.img Aug 26 03:11:07 devstack sudo[109022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:12 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=55,cinder:INSERT=12,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:11:12 devstack sudo[109022]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.c95a25e5-16fa-4231-beac-20b6dfc6a7892klhnk8e.img" returned: 0 in 5.782s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62c45b9-1e29-4603-84cc-8ddc20e2522d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:13 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:13 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-17954bd7-b093-4134-bcab-4000c450a3ed req-a97c911e-987e-4f87-b0f7-07d3bd9abdf8 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:13 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.689s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:13 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.c95a25e5-16fa-4231-beac-20b6dfc6a7892klhnk8e.img {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:11:13 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Converted 1024.00 MB image at 177.00 MB/s Aug 26 03:11:13 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] c95a25e5-16fa-4231-beac-20b6dfc6a789 was raw, no need to convert to raw {{(pid=94506) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:20 devstack sudo[109074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:11:20 devstack sudo[109074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:20 devstack sudo[109074]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.380s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:11:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:11:23 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=50,cinder:INSERT=12,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:11:23 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:11:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.512s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Uploaded volume to glance image-id: c95a25e5-16fa-4231-beac-20b6dfc6a789. {{(pid=94506) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 03:11:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-17954bd7-b093-4134-bcab-4000c450a3ed req-a97c911e-987e-4f87-b0f7-07d3bd9abdf8 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.257s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-17954bd7-b093-4134-bcab-4000c450a3ed req-a97c911e-987e-4f87-b0f7-07d3bd9abdf8 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-bd60cdf2-43ce-43f7-bed0-eb633ad86c21 tempest-VolumesActionsTest-667907144 None] Copy volume to image completed successfully. Aug 26 03:11:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-17954bd7-b093-4134-bcab-4000c450a3ed req-a97c911e-987e-4f87-b0f7-07d3bd9abdf8 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '627f78c7-4368-4742-9e86-98f91d721631', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:11:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-17954bd7-b093-4134-bcab-4000c450a3ed req-a97c911e-987e-4f87-b0f7-07d3bd9abdf8 tempest-TestServerVolumeAttachmentScenario-1317106513 None] attachment_update completed successfully. Aug 26 03:11:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:40 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff73d33-2617-497b-93cc-87ed29e7b265]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:41 devstack sudo[109579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:41 devstack sudo[109579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:41 devstack sudo[109579]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.467s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:41 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b229b5a0-9cff-4dd8-8d0e-bd90ec112103]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:41 devstack sudo[109605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:41 devstack sudo[109605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:42 devstack sudo[109605]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.646s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:42 devstack sudo[109610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img Aug 26 03:11:42 devstack sudo[109610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (31f62c64-7e26-4abf-8557-940f84c50438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b2173-ecf8-4ea2-8097-abdf189fb722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302b2173-ecf8-4ea2-8097-abdf189fb722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221729766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:48Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae83ff9e-325b-477a-86be-bf3797e4ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae83ff9e-325b-477a-86be-bf3797e4ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f19268f-43b6-4f8f-b0f8-72245ea2ebf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f19268f-43b6-4f8f-b0f8-72245ea2ebf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a', 'volume_name': 'volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2155ad1-baf4-479c-966c-b79d5ccb3045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2155ad1-baf4-479c-966c-b79d5ccb3045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315b5ba4-0acc-43df-8fa7-e95f446b6249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Volume e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a', 'volume_size': 1} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-51715b84-e669-4bcb-adcf-baa10b4a2181 req-105715d1-e223-43c4-b118-9210bf66f8a1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:49 devstack sudo[109610]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img" returned: 0 in 7.021s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8fadd3-13f0-413f-96c2-1c266ae23c6e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:49 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:49 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:49 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.582s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:11:49 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Converted 1024.00 MB image at 145.82 MB/s Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] cddfea96-670c-4607-8b26-539582380398 was raw, converting to qcow2 {{(pid=94506) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d3ea99-b51f-413a-8343-5c6756b6657b]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:49 devstack sudo[109642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img Aug 26 03:11:49 devstack sudo[109642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:50 devstack sudo[109642]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img" returned: 0 in 0.355s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:50 devstack sudo[109646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img Aug 26 03:11:50 devstack sudo[109646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:50 devstack sudo[109646]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img" returned: 1 in 0.349s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:50 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn Aug 26 03:11:50 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:50 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn" returned: 0 in 0.336s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Image conversion details: src /opt/stack/data/cinder/conversion/78587041-049f-4ae8-ac02-37df17a8ac72.temp_image.cddfea96-670c-4607-8b26-539582380398ivthp62d.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:11:50 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a18462-6087-4f45-a5cb-d59bf86bb2aa]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:50 devstack sudo[109656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn Aug 26 03:11:50 devstack sudo[109656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:51 devstack sudo[109656]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_7jt3gcqn" returned: 0 in 0.362s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.865s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Uploaded volume to glance image-id: cddfea96-670c-4607-8b26-539582380398. {{(pid=94506) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.239s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-221729766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:11:48Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Creating volume e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:11:52 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:11:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:52 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a 1073741824 Aug 26 03:11:52 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:52 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8108efa0-5270-42c5-9f42-e1f79c3a4613 tempest-VolumesActionsTest-667907144 None] Copy volume to image completed successfully. Aug 26 03:11:53 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a 1073741824" returned: 0 in 0.473s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:53 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a Aug 26 03:11:53 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:53 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-51715b84-e669-4bcb-adcf-baa10b4a2181 req-105715d1-e223-43c4-b118-9210bf66f8a1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-51715b84-e669-4bcb-adcf-baa10b4a2181 req-105715d1-e223-43c4-b118-9210bf66f8a1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315b5ba4-0acc-43df-8fa7-e95f446b6249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52779d86-c950-4fc7-9aeb-2460ac4b304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:11:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Volume volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a (e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a): created successfully Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52779d86-c950-4fc7-9aeb-2460ac4b304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (31f62c64-7e26-4abf-8557-940f84c50438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:11:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2bc999f3-2b42-42bb-aea4-40f94af1c07f tempest-VolumesActionsTest-1057156710 None] Created volume successfully. Aug 26 03:11:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-51715b84-e669-4bcb-adcf-baa10b4a2181 req-105715d1-e223-43c4-b118-9210bf66f8a1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4696416a-97f6-4301-8e3c-153efc15ff9f', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:11:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-51715b84-e669-4bcb-adcf-baa10b4a2181 req-105715d1-e223-43c4-b118-9210bf66f8a1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] attachment_update completed successfully. Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-06416b0b-d643-42ad-9ffe-b8913b8b7b3e tempest-VolumesActionsTest-1057156710 None] Acquiring lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" by "attach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-06416b0b-d643-42ad-9ffe-b8913b8b7b3e tempest-VolumesActionsTest-1057156710 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" acquired by "attach_volume" :: waited 0.051s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-06416b0b-d643-42ad-9ffe-b8913b8b7b3e tempest-VolumesActionsTest-1057156710 None] Attaching volume e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a to instance 571bcff5-dc98-4b60-aee0-f6267fe2fb6c at mountpoint /dev/vdb on host None. Aug 26 03:11:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-06416b0b-d643-42ad-9ffe-b8913b8b7b3e tempest-VolumesActionsTest-1057156710 None] Attach volume completed successfully. Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-06416b0b-d643-42ad-9ffe-b8913b8b7b3e tempest-VolumesActionsTest-1057156710 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" released by "attach_volume" :: held 0.141s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Acquiring lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Acquiring lock "cinder-quobyte-78587041-049f-4ae8-ac02-37df17a8ac72" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Lock "cinder-quobyte-78587041-049f-4ae8-ac02-37df17a8ac72" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[05122224-148b-40e3-89bb-7bb7a9d561dc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:55 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:55 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-aea49e02-a532-4a32-b4d1-f7a50912f3f8 tempest-VolumesActionsTest-1128097341 None] Terminate volume connection completed successfully. Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea49e02-a532-4a32-b4d1-f7a50912f3f8 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-detach_volume" by "detach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea49e02-a532-4a32-b4d1-f7a50912f3f8 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-aea49e02-a532-4a32-b4d1-f7a50912f3f8 tempest-VolumesActionsTest-1128097341 None] Detaching volume e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a from instance 571bcff5-dc98-4b60-aee0-f6267fe2fb6c. Aug 26 03:11:55 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-aea49e02-a532-4a32-b4d1-f7a50912f3f8 tempest-VolumesActionsTest-1128097341 None] Detach volume completed successfully. Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.658s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea49e02-a532-4a32-b4d1-f7a50912f3f8 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:55 devstack sudo[109717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72 Aug 26 03:11:55 devstack sudo[109717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30004ba0-24b7-44de-9971-ae6145dc011e tempest-VolumesActionsTest-1057156710 None] Acquiring lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-detach_volume" by "detach_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30004ba0-24b7-44de-9971-ae6145dc011e tempest-VolumesActionsTest-1057156710 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-30004ba0-24b7-44de-9971-ae6145dc011e tempest-VolumesActionsTest-1057156710 None] Volume detach called, but volume not attached. Aug 26 03:11:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30004ba0-24b7-44de-9971-ae6145dc011e tempest-VolumesActionsTest-1057156710 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-detach_volume" released by "detach_volume" :: held 0.020s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:56 devstack sudo[109717]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-78587041-049f-4ae8-ac02-37df17a8ac72" returned: 0 in 0.336s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Lock "cinder-quobyte-78587041-049f-4ae8-ac02-37df17a8ac72" released by "delete_volume" :: held 1.049s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Created reservations ['05d72777-717f-413a-b8b3-cac28bf5e21b', 'cbeefbee-bedb-43ea-809f-d4179dc956f9', '5272e577-3b1d-4706-8755-a9fa73950cef', '276224e2-a25e-4778-abe6-b6cc5706136c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:56 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:11:56 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "cinder-quobyte-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-quobyte-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[569b569f-01ec-4c19-a067-d14eba820a89]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-5c842293-7dbe-461b-85e7-6f5f0490b6b0 req-c35d2ebc-0e0b-4c71-99a7-385e73c00536 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Terminate volume connection completed successfully. Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-5c842293-7dbe-461b-85e7-6f5f0490b6b0 req-c35d2ebc-0e0b-4c71-99a7-385e73c00536 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Deleting attachment 4696416a-97f6-4301-8e3c-153efc15ff9f. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:11:56 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:56 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a Aug 26 03:11:56 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.306s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Deleted volume successfully. Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e75a1b2f-55c0-4e76-9b8c-0c8785f05ac2 tempest-VolumesActionsTest-667907144 None] Lock "cinder-78587041-049f-4ae8-ac02-37df17a8ac72-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:56 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:56 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a Aug 26 03:11:56 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:57 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" returned: 0 in 0.269s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-quobyte-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a" released by "delete_volume" :: held 0.726s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Created reservations ['1b4f2b86-4b24-411a-9ba3-8d531f9c1b94', 'b8825b26-e76c-4230-b52c-bd231670ffc7', '3b33b6ff-5983-4cbd-9989-527e9647fb76', 'f243a8dd-a7e3-4bf8-b422-73878d429062'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:11:57 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:11:57 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:11:57 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.386s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:11:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Deleted volume successfully. Aug 26 03:11:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e86047ff-8ebc-469d-8abc-b05eea4ac300 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-e3b2f19d-b319-43d5-a4a8-ed0e1dc50d2a-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:11:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-a471b929-5932-4954-92ff-0339af4c8c7e req-fad9a766-5ad4-4071-b6c5-29a9d478cdb1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Terminate volume connection completed successfully. Aug 26 03:11:58 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-a471b929-5932-4954-92ff-0339af4c8c7e req-fad9a766-5ad4-4071-b6c5-29a9d478cdb1 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Deleting attachment 627f78c7-4368-4742-9e86-98f91d721631. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (25a2dad6-21a2-4358-a03d-ea5a05bce2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1103005e-b6b7-4a68-81d5-c984cb025512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1103005e-b6b7-4a68-81d5-c984cb025512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-843008145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbf9483-7218-4f4f-94ef-e6e974e675a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:02Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192b9fd9-5ccf-48de-ba21-2fe28528f293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (192b9fd9-5ccf-48de-ba21-2fe28528f293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff919702-4f1b-4757-b0be-7ca0847df7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff919702-4f1b-4757-b0be-7ca0847df7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbf9483-7218-4f4f-94ef-e6e974e675a6', 'volume_name': 'volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9cfea4-9df2-42c9-a09d-71f8d284a54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9cfea4-9df2-42c9-a09d-71f8d284a54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb499d46-bad6-4aa6-b3ed-313aebd2b811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:02 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Volume 2cbf9483-7218-4f4f-94ef-e6e974e675a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6', 'volume_size': 1} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-843008145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbf9483-7218-4f4f-94ef-e6e974e675a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:02Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Creating volume 2cbf9483-7218-4f4f-94ef-e6e974e675a6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:02 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:02 devstack sudo[109823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 1073741824 Aug 26 03:12:02 devstack sudo[109823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:02 devstack sudo[109823]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 1073741824" returned: 0 in 0.563s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:02 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 Aug 26 03:12:02 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:03 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6" returned: 0 in 0.297s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb499d46-bad6-4aa6-b3ed-313aebd2b811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84101e0-9cd1-4e79-83ce-ba49ce1f5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:03 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Volume volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 (2cbf9483-7218-4f4f-94ef-e6e974e675a6): created successfully Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e84101e0-9cd1-4e79-83ce-ba49ce1f5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (25a2dad6-21a2-4358-a03d-ea5a05bce2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e7fb1fa0-38be-4dc6-b7c4-17833034b7e5 tempest-VolumesActionsTest-1057156710 None] Created volume successfully. Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "cinder-16da00c6-abc9-4833-a9be-abe7a5ce86c3-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-16da00c6-abc9-4833-a9be-abe7a5ce86c3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "cinder-quobyte-16da00c6-abc9-4833-a9be-abe7a5ce86c3" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-quobyte-16da00c6-abc9-4833-a9be-abe7a5ce86c3" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d43d65e-2ea3-4c61-8424-43c158b48eda]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-2cbf9483-7218-4f4f-94ef-e6e974e675a6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Lock "cinder-2cbf9483-7218-4f4f-94ef-e6e974e675a6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:04 devstack sudo[109832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 Aug 26 03:12:04 devstack sudo[109832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-quobyte-2cbf9483-7218-4f4f-94ef-e6e974e675a6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-2cbf9483-7218-4f4f-94ef-e6e974e675a6" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[521a1e38-3698-4f33-a00a-4627e9029978]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:04 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 Aug 26 03:12:04 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:04 devstack sudo[109832]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3" returned: 0 in 0.479s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:04 devstack sudo[109839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3 Aug 26 03:12:04 devstack sudo[109839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:05 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6" returned: 0 in 0.542s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:05 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6 Aug 26 03:12:05 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:05 devstack sudo[109839]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-16da00c6-abc9-4833-a9be-abe7a5ce86c3" returned: 0 in 0.405s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-quobyte-16da00c6-abc9-4833-a9be-abe7a5ce86c3" released by "delete_volume" :: held 0.953s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Created reservations ['72f1d5c8-9ab5-48b0-9c95-b6bcf4de9feb', '824061b3-0096-4eb0-ac50-302fae921a74', '60d20fac-df1c-48ec-99d1-85e492ef5121', 'b999ab7a-fafe-4f09-bedb-33fcc59e782e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:05 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbf9483-7218-4f4f-94ef-e6e974e675a6" returned: 0 in 0.361s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:05 devstack sudo[109849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:05 devstack sudo[109849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-2cbf9483-7218-4f4f-94ef-e6e974e675a6" released by "delete_volume" :: held 0.979s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Created reservations ['a17a4820-7b3f-4187-9b99-80669aa5e916', 'd0e61f96-145a-4ce0-8da9-51580ee176fa', 'b892c6b2-7334-47f5-9e47-2f828c83373f', '8fe6c027-e7b5-444f-abd0-b794b23c8ccf'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:05 devstack sudo[109851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:05 devstack sudo[109851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:05 devstack sudo[109849]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.328s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Deleted volume successfully. Aug 26 03:12:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-90b88270-a71e-4e8d-9259-465f53ad4e32 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-16da00c6-abc9-4833-a9be-abe7a5ce86c3-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:06 devstack sudo[109851]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.338s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Deleted volume successfully. Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5e6a1ce5-2158-4d8c-a019-209d23727ace tempest-VolumesActionsTest-1128097341 None] Lock "cinder-2cbf9483-7218-4f4f-94ef-e6e974e675a6-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "cinder-27f7edb6-04d7-4bd8-8f72-d181806a3fc4-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-27f7edb6-04d7-4bd8-8f72-d181806a3fc4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "cinder-quobyte-27f7edb6-04d7-4bd8-8f72-d181806a3fc4" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-quobyte-27f7edb6-04d7-4bd8-8f72-d181806a3fc4" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[003a3fca-34fc-4fd6-a3d4-e44e14906776]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:07 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 Aug 26 03:12:07 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:07 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4" returned: 0 in 0.442s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:07 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4 Aug 26 03:12:07 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (4431a9d0-b018-4aa4-917e-83e5746f007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0f498d-e5d4-4c44-9d31-ced2507cde39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee0f498d-e5d4-4c44-9d31-ced2507cde39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110286123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c3fe00-c9aa-4a7f-8670-b83f34897753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:07Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a9abdc-bbe8-4999-9b90-6f63ce9b222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a9abdc-bbe8-4999-9b90-6f63ce9b222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355cffa8-969f-4967-af28-770a2657dda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (355cffa8-969f-4967-af28-770a2657dda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3c3fe00-c9aa-4a7f-8670-b83f34897753', 'volume_name': 'volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a82aaf4-b8b7-4875-93ef-a42ee9ad2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a82aaf4-b8b7-4875-93ef-a42ee9ad2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b5b25b-e5e8-49a2-8ada-2b866465b56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:07 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Volume a3c3fe00-c9aa-4a7f-8670-b83f34897753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753', 'volume_size': 1} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1110286123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3c3fe00-c9aa-4a7f-8670-b83f34897753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:07Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Creating volume a3c3fe00-c9aa-4a7f-8670-b83f34897753 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:07 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:07 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 1073741824 Aug 26 03:12:07 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:07 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-27f7edb6-04d7-4bd8-8f72-d181806a3fc4" returned: 0 in 0.264s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-quobyte-27f7edb6-04d7-4bd8-8f72-d181806a3fc4" released by "delete_volume" :: held 0.757s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Created reservations ['bf2cad54-9b43-4e87-a6b8-e67af8ebc7e0', '80842e4b-5eef-49d2-bfce-d506918f5a74', 'bdb3f405-1011-4aea-b146-6885241b1ebd', 'a902a25c-af81-4ebf-9668-741bcb279ae7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:07 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:07 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:08 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 1073741824" returned: 0 in 0.584s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:08 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.367s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Deleted volume successfully. Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-be6cf058-2919-451e-bd57-21022ea62ae6 tempest-TestServerVolumeAttachmentScenario-1317106513 None] Lock "cinder-27f7edb6-04d7-4bd8-8f72-d181806a3fc4-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:08 devstack sudo[109872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 Aug 26 03:12:08 devstack sudo[109872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Flow 'volume_create_manager' (e87214fa-4d1e-426b-88af-e408245f9cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f2e832-859b-4e40-9409-895298eedd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:08 devstack sudo[109872]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f2e832-859b-4e40-9409-895298eedd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-863758449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd6613b-8844-4ade-aefb-c2af79fde6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edbd961fe50434883bb0d33a0148335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:08Z,use_quota=True,user_id='d596856456554760a19ad956483c60d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7654a1fb-adff-4314-aaaa-0e21a4e9612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7654a1fb-adff-4314-aaaa-0e21a4e9612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15c7f8b-58dd-4f3e-bd17-3119de4bed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b5b25b-e5e8-49a2-8ada-2b866465b56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e64a0df-d21f-4c7d-b94f-dbc798277ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:08 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Volume volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 (a3c3fe00-c9aa-4a7f-8670-b83f34897753): created successfully Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e64a0df-d21f-4c7d-b94f-dbc798277ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (4431a9d0-b018-4aa4-917e-83e5746f007a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1378569b-6f4f-4b6e-af80-49d5205cc9d3 tempest-VolumesActionsTest-1057156710 None] Created volume successfully. Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c15c7f8b-58dd-4f3e-bd17-3119de4bed76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0bd6613b-8844-4ade-aefb-c2af79fde6ad', 'volume_name': 'volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b8b2ef-0491-43bd-8c4a-4c78f24cae61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b8b2ef-0491-43bd-8c4a-4c78f24cae61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaaa402-a9ff-4cad-b174-79de51654c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:08 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Volume 0bd6613b-8844-4ade-aefb-c2af79fde6ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 26 03:12:08 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Trying to clone 0bd6613b-8844-4ade-aefb-c2af79fde6ad from image c93cc321-597b-4580-96b0-992799bdc1cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:12:09 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Image download 20.69 MB at 20.69 MB/s Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1502d9c-cc65-4a63-aa9d-aa5a28c8daf0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:09 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD Aug 26 03:12:09 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:09 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-a3c3fe00-c9aa-4a7f-8670-b83f34897753-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf is fetched for user d596856456554760a19ad956483c60d7. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-a3c3fe00-c9aa-4a7f-8670-b83f34897753-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-quobyte-a3c3fe00-c9aa-4a7f-8670-b83f34897753" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[81240757-9780-42f8-8bdf-37f6d1508b2c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-a3c3fe00-c9aa-4a7f-8670-b83f34897753" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a31e0c-0ff7-4838-aafd-9f53217fcdad]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:10 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD Aug 26 03:12:10 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:10 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 Aug 26 03:12:10 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:10 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-863758449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd6613b-8844-4ade-aefb-c2af79fde6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edbd961fe50434883bb0d33a0148335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:08Z,use_quota=True,user_id='d596856456554760a19ad956483c60d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Creating volume 0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:10 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:10 devstack sudo[109889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 1073741824 Aug 26 03:12:10 devstack sudo[109889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:10 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:10 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753 Aug 26 03:12:10 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:10 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a3c3fe00-c9aa-4a7f-8670-b83f34897753" returned: 0 in 0.275s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-a3c3fe00-c9aa-4a7f-8670-b83f34897753" released by "delete_volume" :: held 0.744s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Created reservations ['800c1a43-bd22-47c1-8a2d-c5636454468f', 'efc25b48-232b-491e-9f01-bc95a4ceb260', '9862f120-59d1-496e-a7d8-a1f2d4014f13', '4d710043-82b2-4d20-93f8-1805a23517fc'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:10 devstack sudo[109889]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 1073741824" returned: 0 in 0.534s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:10 devstack sudo[109901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:10 devstack sudo[109901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:10 devstack sudo[109903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad Aug 26 03:12:10 devstack sudo[109903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:11 devstack sudo[109901]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.337s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Deleted volume successfully. Aug 26 03:12:11 devstack sudo[109903]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-e9032496-4d41-4bc7-bb06-bc179db71fb6 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-a3c3fe00-c9aa-4a7f-8670-b83f34897753-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Attempting download of c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume 0bd6613b-8844-4ade-aefb-c2af79fde6ad. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[becf2da7-8fe3-4379-8cf4-0c0cabdb7e0d]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:11 devstack sudo[109907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac Aug 26 03:12:11 devstack sudo[109907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (bd3e9e7c-80c2-4710-a5e4-394dbeb64be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac69168-b3e8-4a9d-8b9d-7905c73dc3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac69168-b3e8-4a9d-8b9d-7905c73dc3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-351870907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1faa76-821e-48ed-84ef-ac044aa1c502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:12Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5c5797-a37c-4cfb-9b73-cb04df05ab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5c5797-a37c-4cfb-9b73-cb04df05ab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:11 devstack sudo[109907]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090a3230-0ba1-4752-a469-f199c1d83719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (090a3230-0ba1-4752-a469-f199c1d83719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1faa76-821e-48ed-84ef-ac044aa1c502', 'volume_name': 'volume-bc1faa76-821e-48ed-84ef-ac044aa1c502', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20afef4-2f8c-4137-a176-248fd9a3ed05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20afef4-2f8c-4137-a176-248fd9a3ed05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afea923d-e737-42e6-8978-feeee4f30658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:11 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Volume bc1faa76-821e-48ed-84ef-ac044aa1c502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1faa76-821e-48ed-84ef-ac044aa1c502', 'volume_size': 1} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-351870907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1faa76-821e-48ed-84ef-ac044aa1c502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:12Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Creating volume bc1faa76-821e-48ed-84ef-ac044aa1c502 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:11 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:11 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 1073741824 Aug 26 03:12:11 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:11 devstack sudo[109912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac Aug 26 03:12:11 devstack sudo[109912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:12 devstack sudo[109912]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac" returned: 1 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c93cc321-597b-4580-96b0-992799bdc1cf_q_pzqnac' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bf5383-e2ff-4a95-a75b-1cd0e58e587f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 1073741824" returned: 0 in 0.587s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:12 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:12 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 Aug 26 03:12:12 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:12 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD Aug 26 03:12:12 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:12 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502" returned: 0 in 0.306s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:12 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] c93cc321-597b-4580-96b0-992799bdc1cf was qcow2, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afea923d-e737-42e6-8978-feeee4f30658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1faa76-821e-48ed-84ef-ac044aa1c502', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:12 devstack sudo[109928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad Aug 26 03:12:12 devstack sudo[109928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642fbe3f-f20c-43c9-82d8-2acc0354951c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:12 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Volume volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 (bc1faa76-821e-48ed-84ef-ac044aa1c502): created successfully Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642fbe3f-f20c-43c9-82d8-2acc0354951c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (bd3e9e7c-80c2-4710-a5e4-394dbeb64be6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-99944a12-1f2c-49f4-bdb4-47e72030c601 tempest-VolumesActionsTest-1057156710 None] Created volume successfully. Aug 26 03:12:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-bc1faa76-821e-48ed-84ef-ac044aa1c502-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Lock "cinder-bc1faa76-821e-48ed-84ef-ac044aa1c502-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-quobyte-bc1faa76-821e-48ed-84ef-ac044aa1c502" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-bc1faa76-821e-48ed-84ef-ac044aa1c502" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[86acab2a-6bae-4555-becb-dc8868fc877b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:14 devstack sudo[109937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 Aug 26 03:12:14 devstack sudo[109937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:14 devstack sudo[109937]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502" returned: 0 in 0.432s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:14 devstack sudo[109943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502 Aug 26 03:12:14 devstack sudo[109943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:14 devstack sudo[109928]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad" returned: 0 in 2.143s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c93cc321-597b-4580-96b0-992799bdc1cf_40kxx67ydevstack@QuobyteHD, size 112.00 MB, duration 2.14 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:12:14 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Converted 112.00 MB image at 52.22 MB/s Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:14 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 1G Aug 26 03:12:14 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:14 devstack sudo[109943]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bc1faa76-821e-48ed-84ef-ac044aa1c502" returned: 0 in 0.372s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-bc1faa76-821e-48ed-84ef-ac044aa1c502" released by "delete_volume" :: held 0.848s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:14 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Created reservations ['8b5bbb6d-d5e3-4792-9337-9fa4a533b38a', '5b5a1319-49ff-4c21-9130-e2c277ecedcc', '677252ff-aa50-410f-bac2-8774afe8bfec', '6fe6e2ec-0cca-4c4a-9fba-b7f92aaa35ab'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:15 devstack sudo[109949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:15 devstack sudo[109949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:15 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 1G" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Downloaded image c93cc321-597b-4580-96b0-992799bdc1cf ((None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}])) to volume 0bd6613b-8844-4ade-aefb-c2af79fde6ad successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Temporary image c93cc321-597b-4580-96b0-992799bdc1cf for user d596856456554760a19ad956483c60d7 is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Marking volume 0bd6613b-8844-4ade-aefb-c2af79fde6ad as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Copying metadata from image c93cc321-597b-4580-96b0-992799bdc1cf to 0bd6613b-8844-4ade-aefb-c2af79fde6ad. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Creating volume glance metadata for volume 0bd6613b-8844-4ade-aefb-c2af79fde6ad backed by image c93cc321-597b-4580-96b0-992799bdc1cf with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:12:15 devstack sudo[109949]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.357s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:15 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Deleted volume successfully. Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-721529ab-5752-42fd-8720-3de4b7efa64f tempest-VolumesActionsTest-1128097341 None] Lock "cinder-bc1faa76-821e-48ed-84ef-ac044aa1c502-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eaaa402-a9ff-4cad-b174-79de51654c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad', 'volume_size': 1, 'image_id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c93cc321-597b-4580-96b0-992799bdc1cf', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6679c89a56764efabfe80517590239e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c93cc321-597b-4580-96b0-992799bdc1cf', 'created_at': datetime.datetime(2026, 8, 26, 0, 50, 58, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c93cc321-597b-4580-96b0-992799bdc1cf/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58e2322-17b0-48c4-8e67-84b8e3d78b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:15 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Volume volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad (0bd6613b-8844-4ade-aefb-c2af79fde6ad): created successfully Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d58e2322-17b0-48c4-8e67-84b8e3d78b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Flow 'volume_create_manager' (e87214fa-4d1e-426b-88af-e408245f9cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:15 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2a79d36d-2454-4600-a73f-c1c128ba783d tempest-VolumesExtendTest-1250871520 None] Created volume successfully. Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (de59dd71-d278-4069-8e88-c63c6c35950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4943a15-16ca-49ae-9625-d949421e5c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4943a15-16ca-49ae-9625-d949421e5c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1086502198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c7bdac-a1aa-4305-a625-274f91b3cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:16Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4540577b-9b94-449a-9a69-df2c1351d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4540577b-9b94-449a-9a69-df2c1351d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db9b1e4-5d2d-4d47-b7f7-014d4f6a1eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4db9b1e4-5d2d-4d47-b7f7-014d4f6a1eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31c7bdac-a1aa-4305-a625-274f91b3cdfe', 'volume_name': 'volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc8550a-0b7b-4769-bce7-8ea67e1d0288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc8550a-0b7b-4769-bce7-8ea67e1d0288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d05dd20-6826-47fd-97f7-fc655fa24a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:15 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Volume 31c7bdac-a1aa-4305-a625-274f91b3cdfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe', 'volume_size': 1} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1086502198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c7bdac-a1aa-4305-a625-274f91b3cdfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:16Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Creating volume 31c7bdac-a1aa-4305-a625-274f91b3cdfe {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:16 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:16 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe 1073741824 Aug 26 03:12:16 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:16 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe 1073741824" returned: 0 in 0.523s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:16 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe Aug 26 03:12:16 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:16 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.665s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d05dd20-6826-47fd-97f7-fc655fa24a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33617933-6910-4421-8cb7-da7dc1b0374d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[67edf54b-7f7b-49d2-897a-8e883033e1cc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Volume volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe (31c7bdac-a1aa-4305-a625-274f91b3cdfe): created successfully Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33617933-6910-4421-8cb7-da7dc1b0374d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (de59dd71-d278-4069-8e88-c63c6c35950b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1c8cef24-be89-40b9-b273-7fcbb9e01016 tempest-VolumesActionsTest-1057156710 None] Created volume successfully. Aug 26 03:12:17 devstack sudo[109967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad Aug 26 03:12:17 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:17 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad" returned: 0 in 0.461s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 2G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad 2G" returned: 0 in 0.092s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.591s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b4ae5afc-3e36-4cc6-b250-14fd7faa9aff tempest-VolumesExtendTest-1250871520 None] Extend volume completed successfully. Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-31c7bdac-a1aa-4305-a625-274f91b3cdfe-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-31c7bdac-a1aa-4305-a625-274f91b3cdfe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "cinder-quobyte-31c7bdac-a1aa-4305-a625-274f91b3cdfe" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-31c7bdac-a1aa-4305-a625-274f91b3cdfe" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d1c0aa-a406-4974-9e3a-268050346e1e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:18 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe Aug 26 03:12:18 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-0bd6613b-8844-4ade-aefb-c2af79fde6ad-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Lock "cinder-0bd6613b-8844-4ade-aefb-c2af79fde6ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:18 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe" returned: 0 in 0.502s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-quobyte-0bd6613b-8844-4ade-aefb-c2af79fde6ad" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:18 devstack sudo[109982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe Aug 26 03:12:18 devstack sudo[109982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-0bd6613b-8844-4ade-aefb-c2af79fde6ad" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d3cabe-dc65-4e2c-8a54-17e7c49b446a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:18 devstack sudo[109984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad Aug 26 03:12:18 devstack sudo[109984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:18 devstack sudo[109982]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-31c7bdac-a1aa-4305-a625-274f91b3cdfe" returned: 0 in 0.299s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-quobyte-31c7bdac-a1aa-4305-a625-274f91b3cdfe" released by "delete_volume" :: held 0.840s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Created reservations ['347342bd-761a-4292-9c35-4578c36d7d3b', '824a48c1-92bd-40b5-ab38-9d01e43b0725', 'eb15d9e4-db8d-4663-b235-f002b681e8bc', 'e8ee9f44-18f2-46d5-87c3-bffd340ea76a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:19 devstack sudo[109993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:19 devstack sudo[109993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:19 devstack sudo[109984]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad" returned: 0 in 0.465s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:19 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad Aug 26 03:12:19 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:19 devstack sudo[109993]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.403s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:19 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Deleted volume successfully. Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0bd6613b-8844-4ade-aefb-c2af79fde6ad" returned: 0 in 0.343s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-0bd6613b-8844-4ade-aefb-c2af79fde6ad" released by "delete_volume" :: held 0.864s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4266f665-5d89-421b-ae75-dd244a9b2960 tempest-VolumesActionsTest-1128097341 None] Lock "cinder-31c7bdac-a1aa-4305-a625-274f91b3cdfe-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Created reservations ['28ab5cbc-2371-4b33-b1c4-7ba58bbdd487', '6ac7df4e-f542-4610-a044-f7e03ac0fa93', 'd9081bee-c0fd-4f7e-8f47-5c5c935d190b', '6b3f06e7-74e1-4529-a553-02c939983cfb'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:19 devstack sudo[110003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:19 devstack sudo[110003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (7f5e2e0b-b06c-4f41-9162-ac9d1488ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d01664e-7491-4515-b280-7b2ab3865cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d01664e-7491-4515-b280-7b2ab3865cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-552243251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59595e45-1581-4a44-9dec-44a01f6fff8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:20Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1ae152-68aa-4f1d-a602-8dd4722a0d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1ae152-68aa-4f1d-a602-8dd4722a0d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3349a2-49a2-4b95-973d-ad405e95d02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e3349a2-49a2-4b95-973d-ad405e95d02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59595e45-1581-4a44-9dec-44a01f6fff8d', 'volume_name': 'volume-59595e45-1581-4a44-9dec-44a01f6fff8d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2bf166-779e-4a8c-894b-560db26de835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2bf166-779e-4a8c-894b-560db26de835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack sudo[110003]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44da092-8c81-4a1e-baa3-9fb74bd1afe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Volume 59595e45-1581-4a44-9dec-44a01f6fff8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59595e45-1581-4a44-9dec-44a01f6fff8d', 'volume_size': 1} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-552243251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59595e45-1581-4a44-9dec-44a01f6fff8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eadc40da5e34485a0792c4387914f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:20Z,use_quota=True,user_id='6b6d342f4a704a2eb79d9206489eb920',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Creating volume 59595e45-1581-4a44-9dec-44a01f6fff8d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:20 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d 1073741824 Aug 26 03:12:20 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.546s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:20 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Deleted volume successfully. Aug 26 03:12:20 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:20 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-291beb80-aadb-46b4-8962-700e42171c8e tempest-VolumesExtendTest-1250871520 None] Lock "cinder-0bd6613b-8844-4ade-aefb-c2af79fde6ad-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:20 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Flow 'volume_create_manager' (967d54c8-c643-4636-8f9e-5c9a92f653b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6125d81-df0b-41ee-9e32-dda330f7cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.368s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6125d81-df0b-41ee-9e32-dda330f7cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-565612181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ea781d-374e-4bdd-849b-2dbd3e443d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edbd961fe50434883bb0d33a0148335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:21Z,use_quota=True,user_id='d596856456554760a19ad956483c60d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4470ca-6ff7-4e69-a88f-705b73aff7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4470ca-6ff7-4e69-a88f-705b73aff7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fbd856-6da0-44c6-96f2-c183dc3fc5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fbd856-6da0-44c6-96f2-c183dc3fc5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ea781d-374e-4bdd-849b-2dbd3e443d48', 'volume_name': 'volume-35ea781d-374e-4bdd-849b-2dbd3e443d48', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0826fa90-59fc-4752-aaef-8bcf4cc7ba63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0826fa90-59fc-4752-aaef-8bcf4cc7ba63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2794b483-e98b-4282-b528-dd93d175afe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Volume 35ea781d-374e-4bdd-849b-2dbd3e443d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ea781d-374e-4bdd-849b-2dbd3e443d48', 'volume_size': 1} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:20 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d 1073741824" returned: 0 in 0.553s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:20 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d Aug 26 03:12:20 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:21 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-565612181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ea781d-374e-4bdd-849b-2dbd3e443d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edbd961fe50434883bb0d33a0148335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:21Z,use_quota=True,user_id='d596856456554760a19ad956483c60d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Creating volume 35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:21 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b44da092-8c81-4a1e-baa3-9fb74bd1afe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59595e45-1581-4a44-9dec-44a01f6fff8d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd66816-755e-44e2-ba5e-357d758e0122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 1073741824 Aug 26 03:12:21 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Volume volume-59595e45-1581-4a44-9dec-44a01f6fff8d (59595e45-1581-4a44-9dec-44a01f6fff8d): created successfully Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edd66816-755e-44e2-ba5e-357d758e0122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Flow 'volume_create_manager' (7f5e2e0b-b06c-4f41-9162-ac9d1488ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-204136f7-c892-4b03-ad28-8ec7557fea8c tempest-VolumesActionsTest-1057156710 None] Created volume successfully. Aug 26 03:12:21 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 1073741824" returned: 0 in 0.481s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:21 devstack sudo[110025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 Aug 26 03:12:21 devstack sudo[110025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:21 devstack sudo[110025]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48" returned: 0 in 0.269s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2794b483-e98b-4282-b528-dd93d175afe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ea781d-374e-4bdd-849b-2dbd3e443d48', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e2a17c-498e-4f1c-9fc9-a4fec3a4548d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Volume volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 (35ea781d-374e-4bdd-849b-2dbd3e443d48): created successfully Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0e2a17c-498e-4f1c-9fc9-a4fec3a4548d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Flow 'volume_create_manager' (967d54c8-c643-4636-8f9e-5c9a92f653b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5f04ea36-ae5e-4091-b045-1d0fd14c0335 tempest-VolumesExtendTest-1250871520 None] Created volume successfully. Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "cinder-59595e45-1581-4a44-9dec-44a01f6fff8d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-59595e45-1581-4a44-9dec-44a01f6fff8d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "cinder-quobyte-59595e45-1581-4a44-9dec-44a01f6fff8d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-quobyte-59595e45-1581-4a44-9dec-44a01f6fff8d" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a34ded8-b016-4e6b-8611-6da6f7571cb8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Creating offline snapshot 8fb16b85-57ba-46b3-95d5-eb458a99f662 of volume 35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d77861-5440-433b-a0fb-07835c7879ed]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:23 devstack sudo[110062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d Aug 26 03:12:23 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:23 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 Aug 26 03:12:23 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:23 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:23 devstack sudo[110072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d Aug 26 03:12:23 devstack sudo[110072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:23 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48" returned: 0 in 0.423s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:23 devstack sudo[110077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 1G Aug 26 03:12:23 devstack sudo[110077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:23 devstack sudo[110072]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-59595e45-1581-4a44-9dec-44a01f6fff8d" returned: 0 in 0.314s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-quobyte-59595e45-1581-4a44-9dec-44a01f6fff8d" released by "delete_volume" :: held 0.837s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (6443b17a-6b61-4bd7-9f31-5f29269e0c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f477b00b-41d8-443f-81d2-2f7751771b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f477b00b-41d8-443f-81d2-2f7751771b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532466913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9718d2-a546-4020-b815-bd7cf4e67fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:24Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dca3a88-bc8b-4c1e-ae09-381f88253b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dca3a88-bc8b-4c1e-ae09-381f88253b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e400ec-b160-42cd-a893-bb0e6dbc866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02e400ec-b160-42cd-a893-bb0e6dbc866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd9718d2-a546-4020-b815-bd7cf4e67fca', 'volume_name': 'volume-fd9718d2-a546-4020-b815-bd7cf4e67fca', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b0cfdc-6b3c-430e-b721-9846f3dbdd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b0cfdc-6b3c-430e-b721-9846f3dbdd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e0f3be-810c-41f2-a2e7-633913f03281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:23 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Volume fd9718d2-a546-4020-b815-bd7cf4e67fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd9718d2-a546-4020-b815-bd7cf4e67fca', 'volume_size': 1} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:23 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Created reservations ['53b2e439-ed28-4187-a101-5705056752fa', 'c81901cd-7788-453a-9e41-478a46d42280', '27cb120d-c13d-45e9-9a66-a90dac90b68b', 'b859e67f-868e-4128-a460-38de41212b4c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:24 devstack sudo[110077]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 1G" returned: 0 in 0.540s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:24 devstack sudo[110084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 Aug 26 03:12:24 devstack sudo[110084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:24 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:24 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (8a2b8a4e-bf3a-4e25-b48c-3a69ea189536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce04931f-d9d8-419e-8d07-0e9fedc8c289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack sudo[110084]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce04931f-d9d8-419e-8d07-0e9fedc8c289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2033780730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c506e8-3cb1-4623-b29b-d1099b3088ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:24Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0a97a9-7d6e-4612-b3eb-71f9a6d15ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad0a97a9-7d6e-4612-b3eb-71f9a6d15ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efaf6548-8aea-47fd-b432-8c24c86ad7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efaf6548-8aea-47fd-b432-8c24c86ad7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c506e8-3cb1-4623-b29b-d1099b3088ea', 'volume_name': 'volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fdad98-e195-4cf4-9ed9-2595eaafb385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fdad98-e195-4cf4-9ed9-2595eaafb385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caeb9435-7966-4bda-bd62-82d3a23a8630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Volume a9c506e8-3cb1-4623-b29b-d1099b3088ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea', 'volume_size': 1} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.366s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:24 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 is being set with open permissions: ugo+rw Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:24 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Deleted volume successfully. Aug 26 03:12:24 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 Aug 26 03:12:24 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2620f95f-fdbc-4542-8a0c-be94e8450399 tempest-VolumesActionsTest-1057156710 None] Lock "cinder-59595e45-1581-4a44-9dec-44a01f6fff8d-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (9e54a4d7-dd99-4a87-95f2-6f4e15d01379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53e4df7-d38a-41ae-a807-eb425b995341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53e4df7-d38a-41ae-a807-eb425b995341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639668772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6ec461-8045-4954-a2bd-d18759dd9244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a151cc6-a346-4cd6-ba0f-c42b8cb6222d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a151cc6-a346-4cd6-ba0f-c42b8cb6222d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad6c350-fe99-4de0-9864-510adc144ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ad6c350-fe99-4de0-9864-510adc144ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad6ec461-8045-4954-a2bd-d18759dd9244', 'volume_name': 'volume-ad6ec461-8045-4954-a2bd-d18759dd9244', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91a5d35-7781-42f3-958f-494d2cdc7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91a5d35-7781-42f3-958f-494d2cdc7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bbc87f-2bc0-4de9-96de-849e6ff777d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:24 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Volume ad6ec461-8045-4954-a2bd-d18759dd9244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad6ec461-8045-4954-a2bd-d18759dd9244', 'volume_size': 1} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:24 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662" returned: 0 in 0.281s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:24 devstack sudo[110096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info Aug 26 03:12:24 devstack sudo[110096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (549474e8-b243-4928-ae0d-5dc5bd5d157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a22a29-5199-46c4-a31c-451b80a390e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a22a29-5199-46c4-a31c-451b80a390e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528162801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c625036e-211b-4190-958d-78019209f8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafd014d-f7ef-415a-b398-f112bdc4b78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bafd014d-f7ef-415a-b398-f112bdc4b78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4483a9c-c899-4ef8-9ec5-986bb630b3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4483a9c-c899-4ef8-9ec5-986bb630b3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c625036e-211b-4190-958d-78019209f8af', 'volume_name': 'volume-c625036e-211b-4190-958d-78019209f8af', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed67b7a-78e6-483b-8181-c1f159e7aa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed67b7a-78e6-483b-8181-c1f159e7aa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack sudo[110096]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad06e80-cbb0-4387-bf83-248c96d6a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Volume c625036e-211b-4190-958d-78019209f8af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c625036e-211b-4190-958d-78019209f8af', 'volume_size': 1} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info" returned: 0 in 0.342s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:25 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info is being set with open permissions: ugo+rw Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:25 devstack sudo[110099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info Aug 26 03:12:25 devstack sudo[110099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (2b43779b-5598-433d-80cc-0912bf5e5c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37403b4-42e7-4eda-a271-bbb452b10889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack sudo[110099]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.info" returned: 0 in 0.308s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.428s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532466913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd9718d2-a546-4020-b815-bd7cf4e67fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:24Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Creating volume fd9718d2-a546-4020-b815-bd7cf4e67fca {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:25 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f37403b4-42e7-4eda-a271-bbb452b10889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-964414912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43a7c04-8c45-4f4b-945a-05dae4cc2c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack sudo[110102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca 1073741824 Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab37813c-5436-4596-8a76-f3792c8b655f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack sudo[110102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab37813c-5436-4596-8a76-f3792c8b655f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c140399-215c-4867-986e-b17c16abfa04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c140399-215c-4867-986e-b17c16abfa04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a43a7c04-8c45-4f4b-945a-05dae4cc2c48', 'volume_name': 'volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524600b7-7be3-4458-b19a-4a6faf81daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524600b7-7be3-4458-b19a-4a6faf81daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdbbaf7-7e62-428f-983e-f40e72ba1fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:25 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Volume a43a7c04-8c45-4f4b-945a-05dae4cc2c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48', 'volume_size': 1} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b9d0655f-32a6-4d8f-8343-a8ac75b7df83 tempest-VolumesExtendTest-1250871520 None] Create snapshot completed successfully Aug 26 03:12:25 devstack sudo[110102]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca 1073741824" returned: 0 in 0.443s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:25 devstack sudo[110108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca Aug 26 03:12:25 devstack sudo[110108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:26 devstack sudo[110108]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca" returned: 0 in 0.268s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.781s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2033780730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c506e8-3cb1-4623-b29b-d1099b3088ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:24Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Creating volume a9c506e8-3cb1-4623-b29b-d1099b3088ea {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:26 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e0f3be-810c-41f2-a2e7-633913f03281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd9718d2-a546-4020-b815-bd7cf4e67fca', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e06b31-1e94-4460-9f99-88222443e87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:26 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea 1073741824 Aug 26 03:12:26 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Volume volume-fd9718d2-a546-4020-b815-bd7cf4e67fca (fd9718d2-a546-4020-b815-bd7cf4e67fca): created successfully Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55e06b31-1e94-4460-9f99-88222443e87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (6443b17a-6b61-4bd7-9f31-5f29269e0c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d6b2ee8b-8f9e-434f-841c-e4c1e166495b tempest-CreateVolumesFromImageTest-1753687479 None] Created volume successfully. Aug 26 03:12:26 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea 1073741824" returned: 0 in 0.532s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:26 devstack sudo[110118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea Aug 26 03:12:26 devstack sudo[110118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:27 devstack sudo[110118]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea" returned: 0 in 0.249s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.382s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639668772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad6ec461-8045-4954-a2bd-d18759dd9244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Creating volume ad6ec461-8045-4954-a2bd-d18759dd9244 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:27 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caeb9435-7966-4bda-bd62-82d3a23a8630) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:27 devstack sudo[110121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 1073741824 Aug 26 03:12:27 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b800a23-eb71-4e3c-a83e-3a90bbd00e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Volume volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea (a9c506e8-3cb1-4623-b29b-d1099b3088ea): created successfully Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b800a23-eb71-4e3c-a83e-3a90bbd00e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (8a2b8a4e-bf3a-4e25-b48c-3a69ea189536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ad7fb66f-cba2-4250-92e6-fecc4c1f58da tempest-CreateVolumesFromImageTest-1753687479 None] Created volume successfully. Aug 26 03:12:27 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 1073741824" returned: 0 in 0.482s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:27 devstack sudo[110127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 Aug 26 03:12:27 devstack sudo[110127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:27 devstack sudo[110127]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.777s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1528162801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c625036e-211b-4190-958d-78019209f8af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Creating volume c625036e-211b-4190-958d-78019209f8af {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:27 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bbc87f-2bc0-4de9-96de-849e6ff777d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad6ec461-8045-4954-a2bd-d18759dd9244', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:27 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af 1073741824 Aug 26 03:12:27 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64cf528-957f-43b4-9e84-a9d8533f36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Volume volume-ad6ec461-8045-4954-a2bd-d18759dd9244 (ad6ec461-8045-4954-a2bd-d18759dd9244): created successfully Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c64cf528-957f-43b4-9e84-a9d8533f36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (9e54a4d7-dd99-4a87-95f2-6f4e15d01379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c12c8fb7-af28-48fb-9c3c-66a695054139 tempest-CreateVolumesFromImageTest-1753687479 None] Created volume successfully. Aug 26 03:12:28 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af 1073741824" returned: 0 in 0.407s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:28 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af Aug 26 03:12:28 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:28 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.087s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-964414912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a43a7c04-8c45-4f4b-945a-05dae4cc2c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0721e3993e34c738549baf5d5b3d715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:25Z,use_quota=True,user_id='37f01538c20141a09b0638d2b69ba94b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Creating volume a43a7c04-8c45-4f4b-945a-05dae4cc2c48 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:28 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:28 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 1073741824 Aug 26 03:12:28 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad06e80-cbb0-4387-bf83-248c96d6a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c625036e-211b-4190-958d-78019209f8af', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d4218e-324e-4a3e-9871-2b1294a217af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:28 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Volume volume-c625036e-211b-4190-958d-78019209f8af (c625036e-211b-4190-958d-78019209f8af): created successfully Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d4218e-324e-4a3e-9871-2b1294a217af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (549474e8-b243-4928-ae0d-5dc5bd5d157c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d0dbc0c6-4986-4213-8e8e-c3beaee0cd88 tempest-CreateVolumesFromImageTest-1753687479 None] Created volume successfully. Aug 26 03:12:29 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 1073741824" returned: 0 in 0.569s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:29 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 Aug 26 03:12:29 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:29 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.136s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbdbbaf7-7e62-428f-983e-f40e72ba1fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e8cf8e-7005-49ca-8404-b15d9335055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3add86e-26e2-42f0-9fb9-99f760b18825]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:29 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Volume volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 (a43a7c04-8c45-4f4b-945a-05dae4cc2c48): created successfully Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e8cf8e-7005-49ca-8404-b15d9335055d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Flow 'volume_create_manager' (2b43779b-5598-433d-80cc-0912bf5e5c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:29 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-618531b3-8358-4626-a387-4aa9bc3703c1 tempest-CreateVolumesFromImageTest-1753687479 None] Created volume successfully. Aug 26 03:12:29 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 Aug 26 03:12:29 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:29 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48" returned: 0 in 0.427s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 2G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-a43a7c04-8c45-4f4b-945a-05dae4cc2c48-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-a43a7c04-8c45-4f4b-945a-05dae4cc2c48-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 2G" returned: 0 in 0.181s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.673s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-quobyte-a43a7c04-8c45-4f4b-945a-05dae4cc2c48" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-a43a7c04-8c45-4f4b-945a-05dae4cc2c48" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42a813-0cbb-4c3e-9f35-f38b4f7d1969]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b944098c-dad8-4fa5-b1d1-9c07ce55bfa8 tempest-VolumesExtendTest-1250871520 None] Extend volume completed successfully. Aug 26 03:12:30 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 Aug 26 03:12:30 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:30 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48" returned: 0 in 0.369s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:30 devstack sudo[110163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48 Aug 26 03:12:30 devstack sudo[110163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-8fb16b85-57ba-46b3-95d5-eb458a99f662-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Lock "cinder-8fb16b85-57ba-46b3-95d5-eb458a99f662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-quobyte-35ea781d-374e-4bdd-849b-2dbd3e443d48" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-35ea781d-374e-4bdd-849b-2dbd3e443d48" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-quobyte-8fb16b85-57ba-46b3-95d5-eb458a99f662" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-8fb16b85-57ba-46b3-95d5-eb458a99f662" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Deleting offline snapshot 8fb16b85-57ba-46b3-95d5-eb458a99f662 of volume 35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:12:30 devstack sudo[110163]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] snapshot_file for this snap is: volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a43a7c04-8c45-4f4b-945a-05dae4cc2c48" returned: 0 in 0.358s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-a43a7c04-8c45-4f4b-945a-05dae4cc2c48" released by "delete_volume" :: held 0.774s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95cfacd-495f-4e19-b75a-88c7a983aca1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Created reservations ['cf2eac7d-0890-4aba-90b9-5e3dcfb3c7e1', 'c3c2ab56-84b5-4b4c-bccd-a664e6b6b45e', 'd472034d-1638-416c-a7c0-90bc1ff8e807', 'e66833f1-04e0-494a-8783-184105ceffb4'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:31 devstack sudo[110166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 Aug 26 03:12:31 devstack sudo[110166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:31 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-c625036e-211b-4190-958d-78019209f8af-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-c625036e-211b-4190-958d-78019209f8af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-quobyte-c625036e-211b-4190-958d-78019209f8af" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-c625036e-211b-4190-958d-78019209f8af" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[79310ff5-a54f-419a-a733-ea68e0622cec]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack sudo[110166]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662" returned: 0 in 0.511s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ea781d-374e-4bdd-849b-2dbd3e443d48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcd20b2-843e-4d9a-ae1a-7887f866d0c6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.343s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:31 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af Aug 26 03:12:31 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Deleted volume successfully. Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-951099cd-98b5-4e6b-a7ce-8edb6103e915 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-a43a7c04-8c45-4f4b-945a-05dae4cc2c48-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:31 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 Aug 26 03:12:31 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af" returned: 0 in 0.441s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack sudo[110184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af Aug 26 03:12:31 devstack sudo[110184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:31 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48" returned: 0 in 0.414s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:31 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 Aug 26 03:12:31 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack sudo[110184]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c625036e-211b-4190-958d-78019209f8af" returned: 0 in 0.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-c625036e-211b-4190-958d-78019209f8af" released by "delete_volume" :: held 0.750s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Created reservations ['f2b3d870-6cc6-432f-af7d-17a5e8ce323c', 'd4e2c26b-d82d-49ad-945b-3a34611f3313', '5f2c1ca0-9797-4d2c-a400-627e20cd1882', '9182301f-a1b3-4d2c-91fb-e61684897701'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:32 devstack sudo[110194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:32 devstack sudo[110194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662" returned: 0 in 0.516s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:32 devstack sudo[110196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662 Aug 26 03:12:32 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-ad6ec461-8045-4954-a2bd-d18759dd9244-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-ad6ec461-8045-4954-a2bd-d18759dd9244-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-quobyte-ad6ec461-8045-4954-a2bd-d18759dd9244" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-ad6ec461-8045-4954-a2bd-d18759dd9244" acquired by "delete_volume" :: waited 0.035s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b584cc-b4ce-4614-b9c1-95cdfcbf9cb0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:32 devstack sudo[110194]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.354s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Deleted volume successfully. Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bd065c9e-7e92-4914-bb5c-c7390191729d tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-c625036e-211b-4190-958d-78019209f8af-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:32 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48.8fb16b85-57ba-46b3-95d5-eb458a99f662" returned: 0 in 0.349s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:32 devstack sudo[110199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 Aug 26 03:12:32 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-8fb16b85-57ba-46b3-95d5-eb458a99f662" released by "_delete_snapshot" :: held 1.933s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-35ea781d-374e-4bdd-849b-2dbd3e443d48" released by "delete_snapshot" :: held 1.966s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Created reservations ['19db2f10-785d-4e33-98e1-b90e15b714c0', 'f195405a-7c56-4386-a058-e55934254ad1', '76f0a700-2828-41eb-94b9-96348aee790d', '0d8b0a88-74e0-4515-bdc9-c5fbf9e23b84'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Delete snapshot completed successfully. Aug 26 03:12:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4a108d5a-43f6-49dd-a476-9ed53b25a8db tempest-VolumesExtendTest-1250871520 None] Lock "cinder-8fb16b85-57ba-46b3-95d5-eb458a99f662-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:33 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244" returned: 0 in 0.443s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:33 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244 Aug 26 03:12:33 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:33 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ad6ec461-8045-4954-a2bd-d18759dd9244" returned: 0 in 0.251s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-ad6ec461-8045-4954-a2bd-d18759dd9244" released by "delete_volume" :: held 0.741s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Created reservations ['940f4882-6f11-4af4-b89b-10715a1efe63', '8806c8c2-c224-4179-8a74-045f873bded3', '4521c63d-45d1-48f9-baff-65b0f857607c', '88a9aa7e-5d77-46ac-a920-a0886595f5bb'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=146,cinder:UPDATE=150,cinder:INSERT=43,cinder:DELETE=11 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:33 devstack sudo[110209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:33 devstack sudo[110209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-a9c506e8-3cb1-4623-b29b-d1099b3088ea-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:33 devstack sudo[110209]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.264s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-a9c506e8-3cb1-4623-b29b-d1099b3088ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Deleted volume successfully. Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=124,cinder:UPDATE=175,cinder:DELETE=16,cinder:INSERT=42 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a367ff51-c99e-4456-a796-5d6fa59fa761 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-ad6ec461-8045-4954-a2bd-d18759dd9244-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-quobyte-a9c506e8-3cb1-4623-b29b-d1099b3088ea" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-a9c506e8-3cb1-4623-b29b-d1099b3088ea" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7586bf3f-ed14-4f9f-a6bf-4b3e0af5362d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:34 devstack sudo[110212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea Aug 26 03:12:34 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-35ea781d-374e-4bdd-849b-2dbd3e443d48-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Lock "cinder-35ea781d-374e-4bdd-849b-2dbd3e443d48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "cinder-quobyte-35ea781d-374e-4bdd-849b-2dbd3e443d48" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-35ea781d-374e-4bdd-849b-2dbd3e443d48" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2fb936-695b-417a-9947-173644aaf23b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:34 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea" returned: 0 in 0.470s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:34 devstack sudo[110219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea Aug 26 03:12:34 devstack sudo[110219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:34 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 Aug 26 03:12:34 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:34 devstack sudo[110219]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9c506e8-3cb1-4623-b29b-d1099b3088ea" returned: 0 in 0.278s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-a9c506e8-3cb1-4623-b29b-d1099b3088ea" released by "delete_volume" :: held 0.800s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Created reservations ['46ebd2d7-8d39-49aa-953c-ba3ebe7aa32c', '95d901d9-a786-4fc2-867b-00f039a05dcd', '04a289a7-c59c-42fb-a9a5-3889f1dfa8b6', 'e2ac3e2d-35b1-4377-a42e-2f40dc44477d'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:34 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48" returned: 0 in 0.409s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:34 devstack sudo[110226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48 Aug 26 03:12:34 devstack sudo[110226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:34 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:34 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-fd9718d2-a546-4020-b815-bd7cf4e67fca-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-fd9718d2-a546-4020-b815-bd7cf4e67fca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "cinder-quobyte-fd9718d2-a546-4020-b815-bd7cf4e67fca" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:35 devstack sudo[110226]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-35ea781d-374e-4bdd-849b-2dbd3e443d48" returned: 0 in 0.354s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-fd9718d2-a546-4020-b815-bd7cf4e67fca" acquired by "delete_volume" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Lock "cinder-quobyte-35ea781d-374e-4bdd-849b-2dbd3e443d48" released by "delete_volume" :: held 0.866s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13f59f-9632-4d9f-9287-4b3af427ddbb]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:35 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.410s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Deleted volume successfully. Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Created reservations ['9d2576cf-7627-4467-b194-8a35798521c8', '8c49dad4-d29b-4de6-b306-8fd158526481', '99203df2-f48c-4dc9-9612-c931e93a2c04', '89c9d3c9-a2b4-4f5f-b993-ae1972267387'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81065dad-2789-4e94-8fea-beb66c5f14d2 tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-a9c506e8-3cb1-4623-b29b-d1099b3088ea-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:35 devstack sudo[110233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca Aug 26 03:12:35 devstack sudo[110233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:35 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:35 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:35 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.305s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:35 devstack sudo[110233]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca" returned: 0 in 0.530s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Deleted volume successfully. Aug 26 03:12:35 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca Aug 26 03:12:35 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cfc7fc98-4d32-488f-8af9-0a48e6f3f0f3 tempest-VolumesExtendTest-1250871520 None] Lock "cinder-35ea781d-374e-4bdd-849b-2dbd3e443d48-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:36 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fd9718d2-a546-4020-b815-bd7cf4e67fca" returned: 0 in 0.321s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-quobyte-fd9718d2-a546-4020-b815-bd7cf4e67fca" released by "delete_volume" :: held 0.898s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Created reservations ['fbbb4d25-06e9-478f-b2d9-effb3b66163b', '5f254890-b918-490b-aaa4-2d37d8306d95', '3f85a2d7-f7c2-4d0b-bb64-114bca4ccb31', '850e48af-fcb8-47b9-8154-592fc606ab03'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:36 devstack sudo[110245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:36 devstack sudo[110245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:36 devstack sudo[110245]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Deleted volume successfully. Aug 26 03:12:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4b947ee0-e553-4336-86f7-2b5a801f016e tempest-CreateVolumesFromImageTest-1753687479 None] Lock "cinder-fd9718d2-a546-4020-b815-bd7cf4e67fca-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Flow 'volume_create_manager' (28e98a0b-3bdc-47f9-b7c6-17e87e384659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b56c71-1487-4ae2-81ab-586da135fc89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b56c71-1487-4ae2-81ab-586da135fc89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-174893187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb5b28f-bec3-40d8-80ae-ec208c3f65dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c87c603ff50f4b008a482f137139e440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:39Z,use_quota=True,user_id='809b118419b4436192d5ed2cb9f1922f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9df449-2e16-4634-b389-68542760e728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9df449-2e16-4634-b389-68542760e728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaa01df-a977-4d85-a452-ece15a219d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccaa01df-a977-4d85-a452-ece15a219d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb5b28f-bec3-40d8-80ae-ec208c3f65dd', 'volume_name': 'volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997b64e8-208f-4921-9727-58b5a9fe178b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997b64e8-208f-4921-9727-58b5a9fe178b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f66ea7-a3d0-40b9-92f5-816bf362d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd', 'volume_size': 1} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-174893187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb5b28f-bec3-40d8-80ae-ec208c3f65dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c87c603ff50f4b008a482f137139e440',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:39Z,use_quota=True,user_id='809b118419b4436192d5ed2cb9f1922f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Creating volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:39 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:39 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd 1073741824 Aug 26 03:12:39 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:40 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd 1073741824" returned: 0 in 0.517s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:40 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd Aug 26 03:12:40 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:40 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" returned: 0 in 0.302s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30f66ea7-a3d0-40b9-92f5-816bf362d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c12eee7-da36-4b1f-88ba-de29c296640d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Volume volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd (1eb5b28f-bec3-40d8-80ae-ec208c3f65dd): created successfully Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c12eee7-da36-4b1f-88ba-de29c296640d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Flow 'volume_create_manager' (28e98a0b-3bdc-47f9-b7c6-17e87e384659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-769947b4-e94a-471f-9ed5-17c9a1a36a97 tempest-VolumesSnapshotListTestJSON-965073210 None] Created volume successfully. Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (9804f636-64b4-437b-876c-808f5aca5a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f774a4d-0b19-4c95-88fd-ade8f82d242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f774a4d-0b19-4c95-88fd-ade8f82d242c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9771590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b603d040-fef2-4c7d-8928-9b382315bfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:41Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee538da-8bb2-4726-b292-9cada7b840c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cee538da-8bb2-4726-b292-9cada7b840c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f64288-8f49-426a-98a5-8c8ed08056ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2f64288-8f49-426a-98a5-8c8ed08056ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b603d040-fef2-4c7d-8928-9b382315bfe6', 'volume_name': 'volume-b603d040-fef2-4c7d-8928-9b382315bfe6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127693e2-e7d0-4a5e-a270-f291c1dcbb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127693e2-e7d0-4a5e-a270-f291c1dcbb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae90432-7647-4f9f-9830-bb6b925035dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume b603d040-fef2-4c7d-8928-9b382315bfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b603d040-fef2-4c7d-8928-9b382315bfe6', 'volume_size': 1} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-9771590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b603d040-fef2-4c7d-8928-9b382315bfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:41Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating volume b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:40 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:40 devstack sudo[110258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 1073741824 Aug 26 03:12:40 devstack sudo[110258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:41 devstack sudo[110258]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 1073741824" returned: 0 in 0.471s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:41 devstack sudo[110264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 Aug 26 03:12:41 devstack sudo[110264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:41 devstack sudo[110264]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6" returned: 0 in 0.283s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ae90432-7647-4f9f-9830-bb6b925035dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b603d040-fef2-4c7d-8928-9b382315bfe6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c5ce34-aedd-4ebf-a727-e9a0b6bf62dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume volume-b603d040-fef2-4c7d-8928-9b382315bfe6 (b603d040-fef2-4c7d-8928-9b382315bfe6): created successfully Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c5ce34-aedd-4ebf-a727-e9a0b6bf62dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (9804f636-64b4-437b-876c-808f5aca5a73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-943880f1-5751-4655-b2c3-43c33f1a972c tempest-CreateVolumesFromSnapshotTest-585389165 None] Created volume successfully. Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Creating offline snapshot bafad358-5e3a-48c1-a6fe-b2b430cc0987 of volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[57363441-dac4-414a-8f3a-9229301313c7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:42 devstack sudo[110267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd Aug 26 03:12:42 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:42 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" returned: 0 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:42 devstack sudo[110273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 1G Aug 26 03:12:42 devstack sudo[110273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Flow 'volume_create_manager' (3cad0f67-c26e-4571-b95f-275486fe7ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b45a743-9dcc-42a5-a167-4da889d0ace7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b45a743-9dcc-42a5-a167-4da889d0ace7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1096799952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fbe422-dd67-4423-bfdf-fad372883a94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d853b7cbff2b4f25aabd57b604a8e86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:42Z,use_quota=True,user_id='e176d3ed0efc44d1b5812e43606fe8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215f977c-76ea-4a94-ba19-81ef2f862c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215f977c-76ea-4a94-ba19-81ef2f862c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03af3b2f-6ad9-480e-876b-26f71d9ce781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03af3b2f-6ad9-480e-876b-26f71d9ce781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61fbe422-dd67-4423-bfdf-fad372883a94', 'volume_name': 'volume-61fbe422-dd67-4423-bfdf-fad372883a94', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af42449-75f2-4139-b0cb-0f09292ce4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6af42449-75f2-4139-b0cb-0f09292ce4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d6823e-47d7-4fd1-9614-7c7e50861c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:42 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Volume 61fbe422-dd67-4423-bfdf-fad372883a94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61fbe422-dd67-4423-bfdf-fad372883a94', 'volume_size': 1} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:42 devstack sudo[110273]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 1G" returned: 0 in 0.398s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:42 devstack sudo[110278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:12:42 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:43 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:43 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 is being set with open permissions: ugo+rw Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:43 devstack sudo[110283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:12:43 devstack sudo[110283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:43 devstack sudo[110283]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.244s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:43 devstack sudo[110287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info Aug 26 03:12:43 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:43 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info" returned: 0 in 0.242s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:43 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info is being set with open permissions: ugo+rw Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:43 devstack sudo[110290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info Aug 26 03:12:43 devstack sudo[110290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:43 devstack sudo[110290]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.info" returned: 0 in 0.231s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.567s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating offline snapshot 72b76121-5588-4350-a739-d699404c3d2d of volume b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f1e09d-065d-41ca-ac69-39bb36390f1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-02ab02ef-63f8-45e1-a92c-6d213fbdbf11 tempest-VolumesSnapshotListTestJSON-965073210 None] Create snapshot completed successfully Aug 26 03:12:43 devstack sudo[110293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 Aug 26 03:12:43 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:44 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6" returned: 0 in 0.389s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:44 devstack sudo[110298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d 1G Aug 26 03:12:44 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:44 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d 1G" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b603d040-fef2-4c7d-8928-9b382315bfe6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:44 devstack sudo[110304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b603d040-fef2-4c7d-8928-9b382315bfe6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d Aug 26 03:12:44 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:44 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b603d040-fef2-4c7d-8928-9b382315bfe6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:44 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d is being set with open permissions: ugo+rw Aug 26 03:12:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:44 devstack sudo[110309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d Aug 26 03:12:44 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:45 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d" returned: 0 in 0.224s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:45 devstack sudo[110312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info Aug 26 03:12:45 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:45 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info" returned: 0 in 0.247s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:45 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info is being set with open permissions: ugo+rw Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:45 devstack sudo[110315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info Aug 26 03:12:45 devstack sudo[110315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:45 devstack sudo[110315]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.info" returned: 0 in 0.226s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.020s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1096799952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fbe422-dd67-4423-bfdf-fad372883a94,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d853b7cbff2b4f25aabd57b604a8e86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:42Z,use_quota=True,user_id='e176d3ed0efc44d1b5812e43606fe8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Creating volume 61fbe422-dd67-4423-bfdf-fad372883a94 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:45 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:45 devstack sudo[110318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 1073741824 Aug 26 03:12:45 devstack sudo[110318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6f2bbfed-cf47-4fbf-8429-0d20c9f7059f tempest-CreateVolumesFromSnapshotTest-585389165 None] Create snapshot completed successfully Aug 26 03:12:46 devstack sudo[110318]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 1073741824" returned: 0 in 0.395s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:46 devstack sudo[110323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 Aug 26 03:12:46 devstack sudo[110323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:46 devstack sudo[110323]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.192s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41d6823e-47d7-4fd1-9614-7c7e50861c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61fbe422-dd67-4423-bfdf-fad372883a94', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b6b279-5405-4f0c-8798-f324b8d7d47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Creating offline snapshot 0afac9fa-b7b0-4a63-96d0-552a728b15f0 of volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:12:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Volume volume-61fbe422-dd67-4423-bfdf-fad372883a94 (61fbe422-dd67-4423-bfdf-fad372883a94): created successfully Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60b6b279-5405-4f0c-8798-f324b8d7d47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Flow 'volume_create_manager' (3cad0f67-c26e-4571-b95f-275486fe7ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6422d76-dfc0-4961-92b0-38d6782bab9e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b70b5194-ec19-46cd-b4cf-3a72d3ed8133 tempest-VolumesListTestJSON-1400838079 None] Created volume successfully. Aug 26 03:12:46 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:12:46 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:46 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (2b38f794-83e8-411d-968c-c698e782fbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8b9868-4e3b-402b-bb04-77dd981a0ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.549s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:12:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8b9868-4e3b-402b-bb04-77dd981a0ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129175966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c041d64f-9e5a-447e-9752-ad75deb6fcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:47Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack sudo[110333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 1G Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153bde3a-c317-4ca8-bbdc-0cff9b4f0c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack sudo[110333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (153bde3a-c317-4ca8-bbdc-0cff9b4f0c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fa58b0-57fb-44dc-97f2-7244960f9495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fa58b0-57fb-44dc-97f2-7244960f9495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c041d64f-9e5a-447e-9752-ad75deb6fcbe', 'volume_name': 'volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3249e271-018f-4cf8-a26e-63daf1d69973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3249e271-018f-4cf8-a26e-63daf1d69973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff406a61-681b-4753-97b1-4e7f391196ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume c041d64f-9e5a-447e-9752-ad75deb6fcbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe', 'volume_size': 1} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Flow 'volume_create_manager' (cfe3e3d3-0581-420c-8fa1-a3d30cadf385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57be13fb-1c08-4169-90ff-485b0bdc0b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57be13fb-1c08-4169-90ff-485b0bdc0b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-382799009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583da9ee-f25d-42ee-8bf9-7fbe93eaeae6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d853b7cbff2b4f25aabd57b604a8e86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:47Z,use_quota=True,user_id='e176d3ed0efc44d1b5812e43606fe8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128324f4-3bc4-45ed-973b-ad734faa9c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128324f4-3bc4-45ed-973b-ad734faa9c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b6c4a7-98aa-4c38-af39-e593650787b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b6c4a7-98aa-4c38-af39-e593650787b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583da9ee-f25d-42ee-8bf9-7fbe93eaeae6', 'volume_name': 'volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b957e27-d6f2-4ac1-8308-3c1f44a2f726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack sudo[110333]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b957e27-d6f2-4ac1-8308-3c1f44a2f726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96868c94-1719-4ad7-ad3e-d08a3d8e6036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Volume 583da9ee-f25d-42ee-8bf9-7fbe93eaeae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6', 'volume_size': 1} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 1G" returned: 0 in 0.655s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:47 devstack sudo[110339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:12:47 devstack sudo[110339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (904ba93d-7655-4690-b9f0-04b09475531e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a85822-0b76-4330-8992-7e4b6241e85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a85822-0b76-4330-8992-7e4b6241e85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665704903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241bc7d3-aa75-425f-bb42-1a71cbb8f88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:48Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6740da79-820f-46ba-b513-e02365e43e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6740da79-820f-46ba-b513-e02365e43e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df475f-a8a3-49d4-9335-15f433e8948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2df475f-a8a3-49d4-9335-15f433e8948a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '241bc7d3-aa75-425f-bb42-1a71cbb8f88c', 'volume_name': 'volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04cf19b-967a-4395-863d-1f13408c8b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04cf19b-967a-4395-863d-1f13408c8b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bd5097-1bf9-470e-8f43-0d19a4b96a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume 241bc7d3-aa75-425f-bb42-1a71cbb8f88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c', 'volume_size': 1} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (5a914c03-1b06-4817-88e8-76cc4786822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8826430-97d5-4f5d-8930-1c2dd272de16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8826430-97d5-4f5d-8930-1c2dd272de16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326105237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdfa3df-4466-4637-a819-2ed69fbecb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:48Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b3ad71-54c9-4886-8cec-c1e63cb72dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b3ad71-54c9-4886-8cec-c1e63cb72dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee95b73-b37b-4876-958e-a7fe4f80ce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee95b73-b37b-4876-958e-a7fe4f80ce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afdfa3df-4466-4637-a819-2ed69fbecb20', 'volume_name': 'volume-afdfa3df-4466-4637-a819-2ed69fbecb20', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af64a7f-4584-4594-a531-1aefc2339152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af64a7f-4584-4594-a531-1aefc2339152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57aec978-906a-41eb-ad1e-31620b3038d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume afdfa3df-4466-4637-a819-2ed69fbecb20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afdfa3df-4466-4637-a819-2ed69fbecb20', 'volume_size': 1} Aug 26 03:12:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:48 devstack sudo[110339]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:48 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 is being set with open permissions: ugo+rw Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:48 devstack sudo[110344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:12:48 devstack sudo[110344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (27205db9-2fbf-4c0e-94ac-3ead2c9dc785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:48 devstack sudo[110344]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1063f0a1-be5a-445a-acf5-13e3d67cc730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.311s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1063f0a1-be5a-445a-acf5-13e3d67cc730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436397969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfadb0d-c898-4a5b-b160-dfa7678ee9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:48Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14da75d3-f716-4fd1-8318-77e74edcc3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14da75d3-f716-4fd1-8318-77e74edcc3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c927cb-776e-420d-8302-31d15683af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c927cb-776e-420d-8302-31d15683af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abfadb0d-c898-4a5b-b160-dfa7678ee9da', 'volume_name': 'volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a47c30d-1a04-485e-80f8-9ab8446360eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a47c30d-1a04-485e-80f8-9ab8446360eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8f1992-3886-4c52-ad88-02e53800163c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume abfadb0d-c898-4a5b-b160-dfa7678ee9da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da', 'volume_size': 1} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-129175966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c041d64f-9e5a-447e-9752-ad75deb6fcbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:47Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating volume c041d64f-9e5a-447e-9752-ad75deb6fcbe {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:48 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:48 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe 1073741824 Aug 26 03:12:48 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-66c11354-fd7d-46cb-ab33-46386495a3e7 tempest-VolumesSnapshotListTestJSON-965073210 None] Create snapshot completed successfully Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (17dc33a5-4e78-4406-8055-2f09d6d916c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e8a716-02ad-4ad8-a7bf-2185ab3e0d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e8a716-02ad-4ad8-a7bf-2185ab3e0d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911228251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b3692f-7ecf-4236-9c6c-0364da15c394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:49Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9a1082-6092-46b1-b9b3-514c97fceb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a9a1082-6092-46b1-b9b3-514c97fceb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8841783a-0dd4-4a88-afef-869130ef8a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8841783a-0dd4-4a88-afef-869130ef8a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b3692f-7ecf-4236-9c6c-0364da15c394', 'volume_name': 'volume-74b3692f-7ecf-4236-9c6c-0364da15c394', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176c3137-8682-426f-bd46-e6c327d8fca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176c3137-8682-426f-bd46-e6c327d8fca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38712d45-5530-4960-87be-1a2585804c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume 74b3692f-7ecf-4236-9c6c-0364da15c394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b3692f-7ecf-4236-9c6c-0364da15c394', 'volume_size': 1} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:48 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe 1073741824" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:48 devstack sudo[110353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe Aug 26 03:12:48 devstack sudo[110353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:49 devstack sudo[110353]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe" returned: 0 in 0.241s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-382799009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583da9ee-f25d-42ee-8bf9-7fbe93eaeae6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d853b7cbff2b4f25aabd57b604a8e86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:47Z,use_quota=True,user_id='e176d3ed0efc44d1b5812e43606fe8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Creating volume 583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:49 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff406a61-681b-4753-97b1-4e7f391196ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c359e3-4037-43d9-a57a-a2bdcf423d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:49 devstack sudo[110356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 1073741824 Aug 26 03:12:49 devstack sudo[110356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:49 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe (c041d64f-9e5a-447e-9752-ad75deb6fcbe): created successfully Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c359e3-4037-43d9-a57a-a2bdcf423d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (2b38f794-83e8-411d-968c-c698e782fbaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4b633941-d3b7-4e7f-a3a0-fed447036b15 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created volume successfully. Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:49 devstack sudo[110356]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 1073741824" returned: 0 in 0.510s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:49 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 Aug 26 03:12:49 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:50 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6" returned: 0 in 0.279s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.254s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665704903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=241bc7d3-aa75-425f-bb42-1a71cbb8f88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:48Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating volume 241bc7d3-aa75-425f-bb42-1a71cbb8f88c {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:50 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96868c94-1719-4ad7-ad3e-d08a3d8e6036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:50 devstack sudo[110365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c 1073741824 Aug 26 03:12:50 devstack sudo[110365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef59b945-ad86-4561-afef-426050c1d237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:50 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Volume volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 (583da9ee-f25d-42ee-8bf9-7fbe93eaeae6): created successfully Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef59b945-ad86-4561-afef-426050c1d237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Flow 'volume_create_manager' (cfe3e3d3-0581-420c-8fa1-a3d30cadf385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b1d37c42-a7c1-49c8-ba6a-f9425a0980ee tempest-VolumesListTestJSON-1400838079 None] Created volume successfully. Aug 26 03:12:50 devstack sudo[110365]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c 1073741824" returned: 0 in 0.459s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:50 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c Aug 26 03:12:50 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:50 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c" returned: 0 in 0.260s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-326105237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afdfa3df-4466-4637-a819-2ed69fbecb20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:48Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating volume afdfa3df-4466-4637-a819-2ed69fbecb20 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:50 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:50 devstack sudo[110374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 1073741824 Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38bd5097-1bf9-470e-8f43-0d19a4b96a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:50 devstack sudo[110374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20723247-0c7d-45c6-9027-57431f879a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:50 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c (241bc7d3-aa75-425f-bb42-1a71cbb8f88c): created successfully Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20723247-0c7d-45c6-9027-57431f879a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (904ba93d-7655-4690-b9f0-04b09475531e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2ae36a31-3507-4c67-b0b1-4dfb0a5cffe7 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created volume successfully. Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Flow 'volume_create_manager' (3435188d-1df0-422f-8dbb-bdfa35315767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dee7ae7-3ceb-4067-8e34-85b03f265112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dee7ae7-3ceb-4067-8e34-85b03f265112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1692049060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bd7aa2-6784-4dbd-af08-2f85b2dd4317,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d853b7cbff2b4f25aabd57b604a8e86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:51Z,use_quota=True,user_id='e176d3ed0efc44d1b5812e43606fe8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce89f2f-5b03-499a-915c-7caf58556696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ce89f2f-5b03-499a-915c-7caf58556696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a34fb7b-046d-4066-ab8f-bc59007d71cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a34fb7b-046d-4066-ab8f-bc59007d71cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7bd7aa2-6784-4dbd-af08-2f85b2dd4317', 'volume_name': 'volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91a1ec5-9701-4924-a7b1-c9725e0c053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91a1ec5-9701-4924-a7b1-c9725e0c053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070ae094-4bb8-47ef-8f43-1982bdd1764a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:51 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Volume a7bd7aa2-6784-4dbd-af08-2f85b2dd4317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317', 'volume_size': 1} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:51 devstack sudo[110374]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 1073741824" returned: 0 in 0.512s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:51 devstack sudo[110379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 Aug 26 03:12:51 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:51 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.219s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-436397969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abfadb0d-c898-4a5b-b160-dfa7678ee9da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:48Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating volume abfadb0d-c898-4a5b-b160-dfa7678ee9da {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:51 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:51 devstack sudo[110382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da 1073741824 Aug 26 03:12:51 devstack sudo[110382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57aec978-906a-41eb-ad1e-31620b3038d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afdfa3df-4466-4637-a819-2ed69fbecb20', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c16c8-6be8-4622-8991-2895848b76c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:51 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume volume-afdfa3df-4466-4637-a819-2ed69fbecb20 (afdfa3df-4466-4637-a819-2ed69fbecb20): created successfully Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a28c16c8-6be8-4622-8991-2895848b76c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (5a914c03-1b06-4817-88e8-76cc4786822a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3794bbde-e37a-43ba-8343-c7f891a82ba3 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created volume successfully. Aug 26 03:12:52 devstack sudo[110382]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da 1073741824" returned: 0 in 0.462s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:52 devstack sudo[110387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da Aug 26 03:12:52 devstack sudo[110387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:52 devstack sudo[110387]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da" returned: 0 in 0.246s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.605s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-911228251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b3692f-7ecf-4236-9c6c-0364da15c394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b461b8a1dbe7443a9e9d9e78999fddb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:49Z,use_quota=True,user_id='ad7f92f6ed404153b5e810f41bef31a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Creating volume 74b3692f-7ecf-4236-9c6c-0364da15c394 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:52 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d8f1992-3886-4c52-ad88-02e53800163c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:52 devstack sudo[110390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 1073741824 Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fccc52d-7e13-40be-a8e0-9fee24cf4724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:52 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:52 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da (abfadb0d-c898-4a5b-b160-dfa7678ee9da): created successfully Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fccc52d-7e13-40be-a8e0-9fee24cf4724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (27205db9-2fbf-4c0e-94ac-3ead2c9dc785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:52 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d4f90ea1-81d1-4bfa-9168-5863ce874c18 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created volume successfully. Aug 26 03:12:52 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 1073741824" returned: 0 in 0.417s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:52 devstack sudo[110396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 Aug 26 03:12:52 devstack sudo[110396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:53 devstack sudo[110396]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394" returned: 0 in 0.247s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.536s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38712d45-5530-4960-87be-1a2585804c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b3692f-7ecf-4236-9c6c-0364da15c394', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9ca063-c076-4aed-8daa-f9f69a6570e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Creating offline snapshot 743006c2-b049-41af-9160-c0909291d473 of volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:12:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Volume volume-74b3692f-7ecf-4236-9c6c-0364da15c394 (74b3692f-7ecf-4236-9c6c-0364da15c394): created successfully Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be9ca063-c076-4aed-8daa-f9f69a6570e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Flow 'volume_create_manager' (17dc33a5-4e78-4406-8055-2f09d6d916c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc286838-4360-4a1c-8245-e6d1879316b4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a2533a0c-9a68-4174-a83c-df0f4a6251c2 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created volume successfully. Aug 26 03:12:53 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:12:53 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:53 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.376s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:12:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:53 devstack sudo[110405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 1G Aug 26 03:12:53 devstack sudo[110405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:54 devstack sudo[110405]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 1G" returned: 0 in 0.466s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:54 devstack sudo[110411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 Aug 26 03:12:54 devstack sudo[110411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-74b3692f-7ecf-4236-9c6c-0364da15c394-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-74b3692f-7ecf-4236-9c6c-0364da15c394-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-74b3692f-7ecf-4236-9c6c-0364da15c394" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-74b3692f-7ecf-4236-9c6c-0364da15c394" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cba775-507f-48e7-9a5d-f2afed5587ea]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:54 devstack sudo[110411]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473" returned: 0 in 0.326s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:54 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 is being set with open permissions: ugo+rw Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:54 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 Aug 26 03:12:54 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:54 devstack sudo[110417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 Aug 26 03:12:54 devstack sudo[110417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:54 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473" returned: 0 in 0.256s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.546s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.393s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1692049060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7bd7aa2-6784-4dbd-af08-2f85b2dd4317,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d853b7cbff2b4f25aabd57b604a8e86e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:12:51Z,use_quota=True,user_id='e176d3ed0efc44d1b5812e43606fe8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Creating volume a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:12:54 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:54 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 1073741824 Aug 26 03:12:54 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:54 devstack sudo[110417]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d4fe5012-dd43-47c4-abc2-dc395bd29724 tempest-VolumesSnapshotListTestJSON-965073210 None] Create snapshot completed successfully Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394" returned: 0 in 0.371s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:54 devstack sudo[110427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394 Aug 26 03:12:54 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:54 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-74b3692f-7ecf-4236-9c6c-0364da15c394" returned: 0 in 0.266s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-74b3692f-7ecf-4236-9c6c-0364da15c394" released by "delete_volume" :: held 0.679s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['a7e6aac3-32e6-41dd-924f-99cbb4b0017c', 'd7458a43-a056-4924-bf50-5a0f8ffac69f', 'f45f6bd4-125c-4097-81e1-f3f71ceb410a', 'ecf83b6b-7717-4caa-97a4-3e4c30340050'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:55 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 1073741824" returned: 0 in 0.441s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:55 devstack sudo[110434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:55 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:55 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 Aug 26 03:12:55 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:55 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.252s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleted volume successfully. Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d7b3093-6625-45a7-85cd-c478f50f93b9 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-74b3692f-7ecf-4236-9c6c-0364da15c394-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-abfadb0d-c898-4a5b-b160-dfa7678ee9da-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:55 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317" returned: 0 in 0.289s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (070ae094-4bb8-47ef-8f43-1982bdd1764a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63609c02-d08e-404c-8566-a0109274d498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-abfadb0d-c898-4a5b-b160-dfa7678ee9da-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Volume volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 (a7bd7aa2-6784-4dbd-af08-2f85b2dd4317): created successfully Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63609c02-d08e-404c-8566-a0109274d498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Flow 'volume_create_manager' (3435188d-1df0-422f-8dbb-bdfa35315767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:12:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-12153ccb-ed4e-4335-8e6e-934a40de3c27 tempest-VolumesListTestJSON-1400838079 None] Created volume successfully. Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-abfadb0d-c898-4a5b-b160-dfa7678ee9da" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-abfadb0d-c898-4a5b-b160-dfa7678ee9da" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61ec0bd-54e0-4492-ab3d-030328696fae]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:55 devstack sudo[110440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da Aug 26 03:12:55 devstack sudo[110440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:55 devstack sudo[110440]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:55 devstack sudo[110445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da Aug 26 03:12:55 devstack sudo[110445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:56 devstack sudo[110445]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-abfadb0d-c898-4a5b-b160-dfa7678ee9da" returned: 0 in 0.268s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-abfadb0d-c898-4a5b-b160-dfa7678ee9da" released by "delete_volume" :: held 0.687s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['a36891ca-f979-4bac-ad90-fea1de2ccda2', '416a1632-aca5-4d03-ba1d-0c3e20b67e85', '59bf8e6a-ee5e-46f6-9e6a-693a76e5c2a8', '04f9c7f5-ea5e-4b7c-9790-f3ca115c87c3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:56 devstack sudo[110448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:56 devstack sudo[110448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-afdfa3df-4466-4637-a819-2ed69fbecb20-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:56 devstack sudo[110448]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.297s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-afdfa3df-4466-4637-a819-2ed69fbecb20-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleted volume successfully. Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-743006c2-b049-41af-9160-c0909291d473-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-682acf2c-f58d-4bbc-9bb0-a08ddfa5846e tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-abfadb0d-c898-4a5b-b160-dfa7678ee9da-delete_volume" released by "delete_volume" :: held 1.280s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-743006c2-b049-41af-9160-c0909291d473-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-afdfa3df-4466-4637-a819-2ed69fbecb20" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-743006c2-b049-41af-9160-c0909291d473" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-afdfa3df-4466-4637-a819-2ed69fbecb20" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-743006c2-b049-41af-9160-c0909291d473" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Deleting offline snapshot 743006c2-b049-41af-9160-c0909291d473 of volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] snapshot_file for this snap is: volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9222e8-909b-474d-849f-5221a0b1268a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d01af-9b95-46e3-99ed-e48835aacb4d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:56 devstack sudo[110451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 Aug 26 03:12:56 devstack sudo[110451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:56 devstack sudo[110452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 Aug 26 03:12:56 devstack sudo[110452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:57 devstack sudo[110451]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20" returned: 0 in 0.427s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:57 devstack sudo[110452]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473" returned: 0 in 0.438s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:12:57 devstack sudo[110462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20 Aug 26 03:12:57 devstack sudo[110462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[464810a9-7f3a-400e-ba62-e618cbf4880e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:57 devstack sudo[110464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:12:57 devstack sudo[110464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:57 devstack sudo[110462]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-afdfa3df-4466-4637-a819-2ed69fbecb20" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-afdfa3df-4466-4637-a819-2ed69fbecb20" released by "delete_volume" :: held 0.770s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['9ed8046f-e0f6-4f8d-8df6-8606f2fc476e', '41a4053f-02e7-45a6-97c9-e69817a77562', 'aadb8ab1-c4cc-4320-a872-a87c99befa38', '02b504e4-5c80-4504-a938-d197a95ace6c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:57 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:57 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:57 devstack sudo[110464]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.475s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:57 devstack sudo[110472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 Aug 26 03:12:57 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-241bc7d3-aa75-425f-bb42-1a71cbb8f88c-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-241bc7d3-aa75-425f-bb42-1a71cbb8f88c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-241bc7d3-aa75-425f-bb42-1a71cbb8f88c" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-241bc7d3-aa75-425f-bb42-1a71cbb8f88c" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5249f-b0a9-42c5-8fd8-c4a4a6cb137b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:58 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleted volume successfully. Aug 26 03:12:58 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c Aug 26 03:12:58 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-af6e2ad1-3944-4566-807b-01b99ffdd874 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-afdfa3df-4466-4637-a819-2ed69fbecb20-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:58 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473" returned: 0 in 0.733s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:58 devstack sudo[110484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473 Aug 26 03:12:58 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:58 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c" returned: 0 in 0.546s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:58 devstack sudo[110488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c Aug 26 03:12:58 devstack sudo[110488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:58 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.743006c2-b049-41af-9160-c0909291d473" returned: 0 in 0.269s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-743006c2-b049-41af-9160-c0909291d473" released by "_delete_snapshot" :: held 2.037s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" released by "delete_snapshot" :: held 2.076s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:58 devstack sudo[110488]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-241bc7d3-aa75-425f-bb42-1a71cbb8f88c" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-241bc7d3-aa75-425f-bb42-1a71cbb8f88c" released by "delete_volume" :: held 0.909s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Created reservations ['8f5107e2-7748-4abb-a80d-9a99409c98b1', '33eeebf7-3c14-4483-a78b-d92f5882657f', '5f43fa05-794d-4788-967a-9d2f47c17a38', 'f5d2e749-5941-4d3c-a648-ba0ae51f8bba'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['48ad7a35-0279-4cfd-accf-ec85a74a4628', 'cbdf3a7c-1773-4e07-a487-21ac0f864e83', '5fcb2f5b-9061-4c69-8c51-3f2284e0026e', '091089c9-f3c8-4cab-ac3c-f0bfd5ea9cee'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:12:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Delete snapshot completed successfully. Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-03a043b0-725e-4fc6-9bce-53e0fd142e20 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-743006c2-b049-41af-9160-c0909291d473-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:59 devstack sudo[110492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:12:59 devstack sudo[110492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "cinder-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "cinder-quobyte-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-quobyte-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b41e614-6150-4064-8c4f-465bce195b81]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:59 devstack sudo[110492]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:12:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleted volume successfully. Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2277f965-1297-428d-b031-44107d094522 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-241bc7d3-aa75-425f-bb42-1a71cbb8f88c-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:59 devstack sudo[110494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 Aug 26 03:12:59 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:59 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:12:59 devstack sudo[110500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317 Aug 26 03:12:59 devstack sudo[110500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-0afac9fa-b7b0-4a63-96d0-552a728b15f0-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-0afac9fa-b7b0-4a63-96d0-552a728b15f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:12:59 devstack sudo[110500]: pam_unix(sudo:session): session closed for user root Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-quobyte-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317" released by "delete_volume" :: held 0.691s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:12:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-0afac9fa-b7b0-4a63-96d0-552a728b15f0" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-0afac9fa-b7b0-4a63-96d0-552a728b15f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Deleting offline snapshot 0afac9fa-b7b0-4a63-96d0-552a728b15f0 of volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] snapshot_file for this snap is: volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f7605f-9b11-4df7-b9e6-0e841274eb93]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Created reservations ['f355772d-2704-41c6-94a8-d6861c7ac66f', '2b378d53-f345-403b-b229-ac53636b1e6d', '59f3cd3c-9e70-41ad-8d01-a474ccb373f1', '7938f975-03cd-40f2-85d1-453fd1365ed9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:00 devstack sudo[110503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:13:00 devstack sudo[110503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-c041d64f-9e5a-447e-9752-ad75deb6fcbe-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:00 devstack sudo[110505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:00 devstack sudo[110505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-c041d64f-9e5a-447e-9752-ad75deb6fcbe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-c041d64f-9e5a-447e-9752-ad75deb6fcbe" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-c041d64f-9e5a-447e-9752-ad75deb6fcbe" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e321f0e6-4484-48e6-b5cb-3cb393399a1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "cinder-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:00 devstack sudo[110505]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:00 devstack sudo[110503]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.453s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.324s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:00 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe Aug 26 03:13:00 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Deleted volume successfully. Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9012be2-e33c-4c62-a00b-7e875221480c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-674c6096-ef6d-42d8-952e-b13fffdfd0be tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-a7bd7aa2-6784-4dbd-af08-2f85b2dd4317-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "cinder-quobyte-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-quobyte-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8986d0d4-8d0c-47aa-8afc-c6ce9ee09472]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:00 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:13:00 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:00 devstack sudo[110515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 Aug 26 03:13:00 devstack sudo[110515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:00 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe" returned: 0 in 0.493s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:00 devstack sudo[110521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe Aug 26 03:13:00 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:00 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.408s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:13:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:01 devstack sudo[110526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:13:01 devstack sudo[110526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:01 devstack sudo[110515]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6" returned: 0 in 0.416s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:01 devstack sudo[110531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6 Aug 26 03:13:01 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:01 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c041d64f-9e5a-447e-9752-ad75deb6fcbe" returned: 0 in 0.307s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-c041d64f-9e5a-447e-9752-ad75deb6fcbe" released by "delete_volume" :: held 0.858s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['0636fcdc-a812-40b9-909f-37adcd1d67a9', '121f94ca-891e-4949-b51c-cc53c54bc88a', '2ee31a23-7823-4f46-a3d4-ab3e15237002', '745f77a5-6915-46ba-990b-5301cd778a89'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:01 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6" returned: 0 in 0.317s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:01 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:01 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-72b76121-5588-4350-a739-d699404c3d2d-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-quobyte-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6" released by "delete_volume" :: held 0.792s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-72b76121-5588-4350-a739-d699404c3d2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-b603d040-fef2-4c7d-8928-9b382315bfe6" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:01 devstack sudo[110526]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.507s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-b603d040-fef2-4c7d-8928-9b382315bfe6" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-72b76121-5588-4350-a739-d699404c3d2d" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:01 devstack sudo[110542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0 Aug 26 03:13:01 devstack sudo[110542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-72b76121-5588-4350-a739-d699404c3d2d" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleting offline snapshot 72b76121-5588-4350-a739-d699404c3d2d of volume b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] snapshot_file for this snap is: volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Created reservations ['1e3a4c36-95ff-4b24-9801-7eaa08fde85c', 'c22ef2c3-ec73-440c-9bac-8fe4e0f2d256', '0af30486-286c-4252-8112-179544833212', '33449fd4-5bf4-427b-8684-c24e355888f4'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[698519f6-aa97-429c-935f-c107c6c1016a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:01 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.299s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleted volume successfully. Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:01 devstack sudo[110544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d Aug 26 03:13:01 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d28a6eb0-284d-4c91-a6b6-c7bf904d28eb tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-c041d64f-9e5a-447e-9752-ad75deb6fcbe-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:01 devstack sudo[110547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:01 devstack sudo[110547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:01 devstack sudo[110542]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.0afac9fa-b7b0-4a63-96d0-552a728b15f0" returned: 0 in 0.345s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "cinder-61fbe422-dd67-4423-bfdf-fad372883a94-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-0afac9fa-b7b0-4a63-96d0-552a728b15f0" released by "_delete_snapshot" :: held 1.861s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" released by "delete_snapshot" :: held 1.905s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-61fbe422-dd67-4423-bfdf-fad372883a94-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "cinder-quobyte-61fbe422-dd67-4423-bfdf-fad372883a94" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-quobyte-61fbe422-dd67-4423-bfdf-fad372883a94" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Created reservations ['5ef610ee-3394-4a17-b7e6-9296cb670dbc', 'ef14fd8c-650c-4441-add9-df4ba6229fe4', '26e82f9d-1559-485d-b5c8-3bb6d8d0a7a7', '47f541ec-7e31-47d8-a404-5da1a4a6d289'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21fa10f-1451-46af-837d-45146fe261c2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack sudo[110547]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Deleted volume successfully. Aug 26 03:13:02 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7b014a7f-1f1c-4f77-be26-b074a4e3e76e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-583da9ee-f25d-42ee-8bf9-7fbe93eaeae6-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d" returned: 0 in 0.528s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b603d040-fef2-4c7d-8928-9b382315bfe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa57f7-e68e-48f5-9f30-1f2557f8547b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Delete snapshot completed successfully. Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-942cc5eb-7dd5-4af9-b81e-340d51a97094 tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-0afac9fa-b7b0-4a63-96d0-552a728b15f0-delete_snapshot" released by "delete_snapshot" :: held 2.195s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:02 devstack sudo[110554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 Aug 26 03:13:02 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:02 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 Aug 26 03:13:02 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:02 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94" returned: 0 in 0.402s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack sudo[110562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94 Aug 26 03:13:02 devstack sudo[110562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:02 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6" returned: 0 in 0.370s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack sudo[110566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d Aug 26 03:13:02 devstack sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:02 devstack sudo[110562]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-61fbe422-dd67-4423-bfdf-fad372883a94" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-quobyte-61fbe422-dd67-4423-bfdf-fad372883a94" released by "delete_volume" :: held 0.734s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Created reservations ['190a233e-e9c8-4814-aa9e-25fade535449', '8ae4614a-3d06-418e-b75a-b1c35a79f5d7', 'def19e81-1dd7-4001-aa31-3d733be3b817', '27ab5be0-4fdc-48b8-bc2e-d3f899e1aef3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack sudo[110566]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:02 devstack sudo[110573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:02 devstack sudo[110573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:02 devstack sudo[110575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d Aug 26 03:13:02 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:03 devstack sudo[110573]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:03 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Deleted volume successfully. Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6.72b76121-5588-4350-a739-d699404c3d2d" returned: 0 in 0.285s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-bafad358-5e3a-48c1-a6fe-b2b430cc0987-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c8d0d8ba-7cac-4f6c-8d94-47069c83f55e tempest-VolumesListTestJSON-1400838079 None] Lock "cinder-61fbe422-dd67-4423-bfdf-fad372883a94-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-72b76121-5588-4350-a739-d699404c3d2d" released by "_delete_snapshot" :: held 1.738s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-bafad358-5e3a-48c1-a6fe-b2b430cc0987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-b603d040-fef2-4c7d-8928-9b382315bfe6" released by "delete_snapshot" :: held 1.784s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-bafad358-5e3a-48c1-a6fe-b2b430cc0987" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-bafad358-5e3a-48c1-a6fe-b2b430cc0987" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Deleting offline snapshot bafad358-5e3a-48c1-a6fe-b2b430cc0987 of volume 1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] snapshot_file for this snap is: volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1079a700-b379-43b1-8993-8ddfb443a5db]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['d08344d8-dc50-4158-a88d-23efaf75b98e', '7dae3d9e-bf2a-4335-8f59-b372ed52b616', '87283cca-c2c8-4e25-b7e5-842151567b4a', 'e21ecc83-c2d0-4ca0-a870-2ab7202020eb'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Delete snapshot completed successfully. Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f1c73ee6-cf73-4f5a-87d7-8c97619fe588 tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-72b76121-5588-4350-a739-d699404c3d2d-delete_snapshot" released by "delete_snapshot" :: held 2.020s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:03 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:13:03 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-b603d040-fef2-4c7d-8928-9b382315bfe6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-b603d040-fef2-4c7d-8928-9b382315bfe6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "cinder-quobyte-b603d040-fef2-4c7d-8928-9b382315bfe6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-b603d040-fef2-4c7d-8928-9b382315bfe6" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2128c9-4475-4b6d-a110-24ff52adc3a4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:03 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.446s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:13:03 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 Aug 26 03:13:03 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df7fed-b1f6-4cdf-a79e-c642d918caa5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:03 devstack sudo[110587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd Aug 26 03:13:03 devstack sudo[110587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:04 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:04 devstack sudo[110593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6 Aug 26 03:13:04 devstack sudo[110593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:04 devstack sudo[110587]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:04 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:13:04 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:04 devstack sudo[110593]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b603d040-fef2-4c7d-8928-9b382315bfe6" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-quobyte-b603d040-fef2-4c7d-8928-9b382315bfe6" released by "delete_volume" :: held 0.812s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Created reservations ['8596356a-2145-4383-9759-0b68354e3fb4', '05a532f7-0b3a-4312-8492-edc708084b8f', '8d3f1bf0-ae5c-47de-99ec-d4517923f316', '9245a95d-8741-4efe-a979-eeabff2b84cc'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:04 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:04 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:04 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.424s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:04 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987 Aug 26 03:13:04 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:04 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.348s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:04 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:04 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Deleted volume successfully. Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-669eee51-1ef4-4d6e-9dd2-ce650c60d56a tempest-CreateVolumesFromSnapshotTest-585389165 None] Lock "cinder-b603d040-fef2-4c7d-8928-9b382315bfe6-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:05 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd.bafad358-5e3a-48c1-a6fe-b2b430cc0987" returned: 0 in 0.360s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-bafad358-5e3a-48c1-a6fe-b2b430cc0987" released by "_delete_snapshot" :: held 1.819s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" released by "delete_snapshot" :: held 1.854s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Created reservations ['55ec75f8-bd1c-4701-a124-638ad2876f8b', '49b15140-96df-476c-82ac-93c4377363c0', '5f71f074-a83d-4b31-ae8c-4a62ff5daacb', '43719fb9-a5db-42fe-a931-6eb7a21236b3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Delete snapshot completed successfully. Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aa75a911-07ee-48e6-a1fb-71e85ede54fd tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-bafad358-5e3a-48c1-a6fe-b2b430cc0987-delete_snapshot" released by "delete_snapshot" :: held 2.016s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[884705d3-fedb-4ad9-b9a8-fc69af2908b6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:05 devstack sudo[110610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd Aug 26 03:13:05 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:06 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" returned: 0 in 0.410s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:06 devstack sudo[110615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd Aug 26 03:13:06 devstack sudo[110615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:06 devstack sudo[110615]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" returned: 0 in 0.306s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-quobyte-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd" released by "delete_volume" :: held 0.781s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Created reservations ['ee4a376e-b842-4cdf-985b-cc8a5e33aacd', '76a101ef-513e-446c-95a2-1705980ddc85', 'd3726c28-bbdb-470a-85ab-f1c99d69d696', '5bd2e698-e37a-483a-857e-33b3a0b90382'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:06 devstack sudo[110618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:06 devstack sudo[110618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Flow 'volume_create_manager' (14e3a71c-f6b8-490b-9e8b-ff5e97efb259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30d43ff-3815-4a26-9692-031708c2499c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30d43ff-3815-4a26-9692-031708c2499c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1134908421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28522f8-90b2-44e2-be10-c46107d9e7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f42e529ef774286a8e8381e6201f7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:07Z,use_quota=True,user_id='83c81b853a624cdab6d637f5cf84c6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:06 devstack sudo[110618]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18542f55-bcf8-4af2-a258-8563c10291cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18542f55-bcf8-4af2-a258-8563c10291cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff43013-bc8d-4909-b9a3-20dc2cba5546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff43013-bc8d-4909-b9a3-20dc2cba5546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b28522f8-90b2-44e2-be10-c46107d9e7dd', 'volume_name': 'volume-b28522f8-90b2-44e2-be10-c46107d9e7dd', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8341de1-55e6-4027-87a0-ffc9f4fa36a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8341de1-55e6-4027-87a0-ffc9f4fa36a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753f221a-1584-46b9-a89b-ff5ca838f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:06 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Volume b28522f8-90b2-44e2-be10-c46107d9e7dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b28522f8-90b2-44e2-be10-c46107d9e7dd', 'volume_size': 1} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1134908421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b28522f8-90b2-44e2-be10-c46107d9e7dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f42e529ef774286a8e8381e6201f7f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:07Z,use_quota=True,user_id='83c81b853a624cdab6d637f5cf84c6c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Creating volume b28522f8-90b2-44e2-be10-c46107d9e7dd {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:13:06 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.477s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:06 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Deleted volume successfully. Aug 26 03:13:06 devstack sudo[110621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd 1073741824 Aug 26 03:13:06 devstack sudo[110621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b5f5abb1-9b76-4a02-a30e-0bca9823eb2f tempest-VolumesSnapshotListTestJSON-965073210 None] Lock "cinder-1eb5b28f-bec3-40d8-80ae-ec208c3f65dd-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:07 devstack sudo[110621]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd 1073741824" returned: 0 in 0.522s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:07 devstack sudo[110627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd Aug 26 03:13:07 devstack sudo[110627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:07 devstack sudo[110627]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd" returned: 0 in 0.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753f221a-1584-46b9-a89b-ff5ca838f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b28522f8-90b2-44e2-be10-c46107d9e7dd', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2dbf1e3-6a6b-412d-937e-ad7bf021ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:07 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Volume volume-b28522f8-90b2-44e2-be10-c46107d9e7dd (b28522f8-90b2-44e2-be10-c46107d9e7dd): created successfully Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2dbf1e3-6a6b-412d-937e-ad7bf021ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:07 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Flow 'volume_create_manager' (14e3a71c-f6b8-490b-9e8b-ff5e97efb259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9547231c-0701-4819-ab08-8f083cc34e86 tempest-VolumesNegativeTest-562369812 None] Created volume successfully. Aug 26 03:13:17 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=169,cinder:SELECT=115,cinder:INSERT=33,cinder:DELETE=16 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:13:17 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=163,cinder:SELECT=123,cinder:INSERT=48,cinder:DELETE=12 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:20 devstack sudo[110751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:20 devstack sudo[110751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:20 devstack sudo[110751]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.412s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:13:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:13:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Acquiring lock "cinder-b28522f8-90b2-44e2-be10-c46107d9e7dd-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Lock "cinder-b28522f8-90b2-44e2-be10-c46107d9e7dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Acquiring lock "cinder-quobyte-b28522f8-90b2-44e2-be10-c46107d9e7dd" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Lock "cinder-quobyte-b28522f8-90b2-44e2-be10-c46107d9e7dd" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2605b3e5-c3e0-4d8f-a2ba-6757f3d9a5c0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:29 devstack sudo[110813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd Aug 26 03:13:29 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:29 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:29 devstack sudo[110818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd Aug 26 03:13:29 devstack sudo[110818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:29 devstack sudo[110818]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b28522f8-90b2-44e2-be10-c46107d9e7dd" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Lock "cinder-quobyte-b28522f8-90b2-44e2-be10-c46107d9e7dd" released by "delete_volume" :: held 0.696s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Created reservations ['dbb364ef-0173-4bc2-8970-9dcb1825b80c', '2b5f726f-810f-4318-a31d-89ab28a69c69', 'ea6b4c58-6223-48d8-ae10-6e035813f2bc', '9434c7c1-097d-40f3-a3be-6adb29a21ef9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:29 devstack sudo[110821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:29 devstack sudo[110821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:30 devstack sudo[110821]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.308s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:30 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Deleted volume successfully. Aug 26 03:13:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ba1dc518-7cc9-4203-8c6e-f2d1908a1806 tempest-VolumesNegativeTest-562369812 None] Lock "cinder-b28522f8-90b2-44e2-be10-c46107d9e7dd-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Flow 'volume_create_manager' (f3b507ac-6faf-4d0d-b84a-d1355ca680ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d0ba2c-f334-4ffa-b83c-e85a5e5f07d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d0ba2c-f334-4ffa-b83c-e85a5e5f07d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-334614892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6252a6a-a969-4ab4-b8bf-a1754724f0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c47c91e14f4e109c3a393ad97310e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:33Z,use_quota=True,user_id='61c80f1d0fe745e98154117694354a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744cb21-1287-44b8-b108-2dd37fd926e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744cb21-1287-44b8-b108-2dd37fd926e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9eb109-c01f-4ed7-bce6-89149bc350ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9eb109-c01f-4ed7-bce6-89149bc350ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6252a6a-a969-4ab4-b8bf-a1754724f0ad', 'volume_name': 'volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad', 'volume_size': 2}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ef36db-9e59-497a-90de-e9d8a781db90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ef36db-9e59-497a-90de-e9d8a781db90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93f45d6-2d79-4c0e-af0c-92d282c936d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Volume e6252a6a-a969-4ab4-b8bf-a1754724f0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad', 'volume_size': 2} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-334614892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6252a6a-a969-4ab4-b8bf-a1754724f0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22c47c91e14f4e109c3a393ad97310e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:33Z,use_quota=True,user_id='61c80f1d0fe745e98154117694354a86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Creating volume e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:13:32 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:13:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad 2147483648 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:32 devstack sudo[110824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad 2147483648 Aug 26 03:13:33 devstack sudo[110824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:33 devstack sudo[110824]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad 2147483648" returned: 0 in 0.585s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:33 devstack sudo[110830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad Aug 26 03:13:33 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:33 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93f45d6-2d79-4c0e-af0c-92d282c936d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad', 'volume_size': 2}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4f63c5-10e4-4c5e-bd5f-304536726515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Volume volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad (e6252a6a-a969-4ab4-b8bf-a1754724f0ad): created successfully Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4f63c5-10e4-4c5e-bd5f-304536726515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Flow 'volume_create_manager' (f3b507ac-6faf-4d0d-b84a-d1355ca680ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-777e7674-33c2-4b03-805e-76964fbbdc24 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Created volume successfully. Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Creating offline snapshot 1c0643ca-4921-4da9-95eb-bac28c03d9f4 of volume e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b9bc50-4d91-405d-9597-643fbf628cf7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:35 devstack sudo[110833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad Aug 26 03:13:35 devstack sudo[110833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:35 devstack sudo[110833]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" returned: 0 in 0.376s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 2G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:35 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 2G Aug 26 03:13:35 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:35 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 2G" returned: 0 in 0.420s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:35 devstack sudo[110845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 Aug 26 03:13:35 devstack sudo[110845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:36 devstack sudo[110845]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4" returned: 0 in 0.301s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:36 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 is being set with open permissions: ugo+rw Aug 26 03:13:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:36 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 Aug 26 03:13:36 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:36 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4" returned: 0 in 0.260s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:36 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info Aug 26 03:13:36 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:36 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info" returned: 0 in 0.263s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:36 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info is being set with open permissions: ugo+rw Aug 26 03:13:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:36 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info Aug 26 03:13:36 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:37 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.info" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-36801291-6f40-4f80-81c1-e8e3b969327a tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Create snapshot completed successfully Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "cinder-1c0643ca-4921-4da9-95eb-bac28c03d9f4-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-1c0643ca-4921-4da9-95eb-bac28c03d9f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "cinder-quobyte-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-quobyte-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "cinder-quobyte-1c0643ca-4921-4da9-95eb-bac28c03d9f4" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-quobyte-1c0643ca-4921-4da9-95eb-bac28c03d9f4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Deleting offline snapshot 1c0643ca-4921-4da9-95eb-bac28c03d9f4 of volume e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] snapshot_file for this snap is: volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[217143ac-fe3b-4aef-9f41-a5326750baf9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:37 devstack sudo[110860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 Aug 26 03:13:37 devstack sudo[110860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Flow 'volume_create_manager' (1f4f9452-eba5-44bb-8d84-a432dd187fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9119e95-1417-4a88-8b58-a16cd13bffc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9119e95-1417-4a88-8b58-a16cd13bffc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-114498243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcbe6c6-bb79-4505-977e-f514bb89eba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c180387fe6d4afe889ad6f9d3789ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:38Z,use_quota=True,user_id='10f4f96856544ccda98696a3d7dc7a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(339601ee-d475-4daf-bc8b-316e7c456d30),volume_type_id=339601ee-d475-4daf-bc8b-316e7c456d30)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3d6a0-2876-4782-a86b-db07a32fb0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3d6a0-2876-4782-a86b-db07a32fb0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2333d679-7930-4b30-8c29-e35ab8fc5ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2333d679-7930-4b30-8c29-e35ab8fc5ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bcbe6c6-bb79-4505-977e-f514bb89eba8', 'volume_name': 'volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7b232b-1cc2-4be9-8ab0-21dd6b663960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e7b232b-1cc2-4be9-8ab0-21dd6b663960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9b8b8c-5365-44bd-aed3-0826bd384d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Volume 1bcbe6c6-bb79-4505-977e-f514bb89eba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8', 'volume_size': 1} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-114498243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcbe6c6-bb79-4505-977e-f514bb89eba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c180387fe6d4afe889ad6f9d3789ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:38Z,use_quota=True,user_id='10f4f96856544ccda98696a3d7dc7a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(339601ee-d475-4daf-bc8b-316e7c456d30),volume_type_id=339601ee-d475-4daf-bc8b-316e7c456d30)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Creating volume 1bcbe6c6-bb79-4505-977e-f514bb89eba8 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:13:37 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:37 devstack sudo[110864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 1073741824 Aug 26 03:13:37 devstack sudo[110864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:37 devstack sudo[110860]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4" returned: 0 in 0.412s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4523f5f6-429e-45bb-bb7f-7517997798c2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:38 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad Aug 26 03:13:38 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Flow 'volume_create_manager' (4308cf77-0d0b-41a2-96a5-b52be2fcbbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6697c748-a7c6-4d06-94b1-14af48c55c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6697c748-a7c6-4d06-94b1-14af48c55c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1398707345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c180387fe6d4afe889ad6f9d3789ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:38Z,use_quota=True,user_id='10f4f96856544ccda98696a3d7dc7a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c2bc42e-a3c5-4992-ac78-e0164f0e6f1c),volume_type_id=2c2bc42e-a3c5-4992-ac78-e0164f0e6f1c)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c4a9a-cd27-4f86-8c47-bab0ffc0421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (081c4a9a-cd27-4f86-8c47-bab0ffc0421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b993d7b-25ac-41f1-9b46-3f98f8a8e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b993d7b-25ac-41f1-9b46-3f98f8a8e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb', 'volume_name': 'volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92a2f6d-518b-4c4d-b8a1-b3fd8b539d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92a2f6d-518b-4c4d-b8a1-b3fd8b539d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67da9a8-f4bc-4813-b44c-742fe1b8bc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Volume 1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb', 'volume_size': 1} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:38 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" returned: 0 in 0.419s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:38 devstack sudo[110864]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 1073741824" returned: 0 in 0.553s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:38 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 Aug 26 03:13:38 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:38 devstack sudo[110879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 Aug 26 03:13:38 devstack sudo[110879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:38 devstack sudo[110879]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8" returned: 0 in 0.320s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.481s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1398707345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c180387fe6d4afe889ad6f9d3789ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:38Z,use_quota=True,user_id='10f4f96856544ccda98696a3d7dc7a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c2bc42e-a3c5-4992-ac78-e0164f0e6f1c),volume_type_id=2c2bc42e-a3c5-4992-ac78-e0164f0e6f1c)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Creating volume 1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:13:38 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:38 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:38 devstack sudo[110885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb 1073741824 Aug 26 03:13:38 devstack sudo[110885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f9b8b8c-5365-44bd-aed3-0826bd384d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d655c7-14ac-4a09-8589-95ecb681d9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4" returned: 0 in 0.481s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Volume volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 (1bcbe6c6-bb79-4505-977e-f514bb89eba8): created successfully Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90d655c7-14ac-4a09-8589-95ecb681d9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4 Aug 26 03:13:38 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Flow 'volume_create_manager' (1f4f9452-eba5-44bb-8d84-a432dd187fb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Flow 'volume_create_manager' (0e0a4564-de5a-4ef4-9b77-09003bf4d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da4cdf-9f64-41e0-abd8-b916532002eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c8732d9b-9782-4dc1-86d1-824410ff4e6c tempest-TestInstancesWithCinderVolumes-296739032 None] Created volume successfully. Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da4cdf-9f64-41e0-abd8-b916532002eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-600554000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b878c859-4568-4963-b6ef-a6030627c390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c180387fe6d4afe889ad6f9d3789ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:39Z,use_quota=True,user_id='10f4f96856544ccda98696a3d7dc7a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f266bdb-da31-4542-b68a-f3464c0fe846),volume_type_id=1f266bdb-da31-4542-b68a-f3464c0fe846)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e45346d-7b66-423a-9658-74f700e0f6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e45346d-7b66-423a-9658-74f700e0f6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef71a14-1670-4053-bbde-64136087956a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:38 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:13:39 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad.1c0643ca-4921-4da9-95eb-bac28c03d9f4" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-quobyte-1c0643ca-4921-4da9-95eb-bac28c03d9f4" released by "_delete_snapshot" :: held 1.723s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-quobyte-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" released by "delete_snapshot" :: held 1.748s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Created reservations ['eda651a0-f1f7-40a5-9fd8-d557730275cc', '5edb9828-8bba-4208-8877-0f5a881d8f33', '7a46a84d-edb6-4233-aed1-6f2950ce2a92', '38cebd47-a3ec-440d-ae8c-0759bbd0b521'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:39 devstack sudo[110885]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb 1073741824" returned: 0 in 0.516s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef71a14-1670-4053-bbde-64136087956a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b878c859-4568-4963-b6ef-a6030627c390', 'volume_name': 'volume-b878c859-4568-4963-b6ef-a6030627c390', 'volume_size': 1, 'image_id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0325af5e-f0cb-4cc4-885f-6cf179981578', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2117374373', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c180387fe6d4afe889ad6f9d3789ad5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'created_at': datetime.datetime(2026, 8, 26, 1, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 13, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0325af5e-f0cb-4cc4-885f-6cf179981578/file', 'properties': {}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987a28c0-9161-4625-971c-72b2b1dbb761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (987a28c0-9161-4625-971c-72b2b1dbb761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c0956e-8eff-4593-acdc-9e8688d78f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Volume b878c859-4568-4963-b6ef-a6030627c390: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b878c859-4568-4963-b6ef-a6030627c390', 'volume_size': 1, 'image_id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0325af5e-f0cb-4cc4-885f-6cf179981578', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2117374373', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c180387fe6d4afe889ad6f9d3789ad5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'created_at': datetime.datetime(2026, 8, 26, 1, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 13, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0325af5e-f0cb-4cc4-885f-6cf179981578/file', 'properties': {}}, 'image_service': } Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Trying to clone b878c859-4568-4963-b6ef-a6030627c390 from image 0325af5e-f0cb-4cc4-885f-6cf179981578 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0325af5e-f0cb-4cc4-885f-6cf179981578', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:39 devstack sudo[110893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb Aug 26 03:13:39 devstack sudo[110893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:39 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Delete snapshot completed successfully. Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6c629752-e0d2-4e1b-b186-9504c86c331f tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-1c0643ca-4921-4da9-95eb-bac28c03d9f4-delete_snapshot" released by "delete_snapshot" :: held 1.962s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:39 devstack sudo[110893]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb" returned: 0 in 0.281s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67da9a8-f4bc-4813-b44c-742fe1b8bc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a60b92c-d710-4e10-913d-bef236098daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "cinder-e6252a6a-a969-4ab4-b8bf-a1754724f0ad-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Volume volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb (1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb): created successfully Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a60b92c-d710-4e10-913d-bef236098daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Flow 'volume_create_manager' (4308cf77-0d0b-41a2-96a5-b52be2fcbbd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-e6252a6a-a969-4ab4-b8bf-a1754724f0ad-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:39 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9ef15a5b-8282-4109-9015-f8618c2bc390 tempest-TestInstancesWithCinderVolumes-296739032 None] Created volume successfully. Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "cinder-quobyte-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-quobyte-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691d3ce-2a24-4c19-a7f9-d95138048f1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:39 devstack sudo[110896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad Aug 26 03:13:39 devstack sudo[110896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:40 devstack sudo[110896]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" returned: 0 in 0.384s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:40 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad Aug 26 03:13:40 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:40 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" returned: 0 in 0.257s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-quobyte-e6252a6a-a969-4ab4-b8bf-a1754724f0ad" released by "delete_volume" :: held 0.705s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Created reservations ['ec1d00fd-4fe2-44ae-a83d-3f6f072026d1', 'a8bd513d-79be-4e38-a42b-7783e5286894', '8398b825-769d-42f7-a61c-384463796c03', '816e31f7-65e9-4d41-9bcb-fee588ee27be'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:40 devstack sudo[110904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:13:40 devstack sudo[110904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:40 devstack sudo[110904]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.257s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:13:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Deleted volume successfully. Aug 26 03:13:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-04c51f44-b9ed-494e-921d-3281ef918da1 tempest-VolumesSnapshotNegativeTestJSON-1568786856 None] Lock "cinder-e6252a6a-a969-4ab4-b8bf-a1754724f0ad-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:13:42 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD, size 20.69 MB, duration 3.39 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:13:42 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Image download 20.69 MB at 6.11 MB/s Aug 26 03:13:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a8aafc-c271-4cd7-b94b-d5d28e36d482]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:42 devstack sudo[110907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD Aug 26 03:13:42 devstack sudo[110907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:43 devstack sudo[110907]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD" returned: 0 in 0.343s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Temporary image 0325af5e-f0cb-4cc4-885f-6cf179981578 is fetched for user 10f4f96856544ccda98696a3d7dc7a7d. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b815e-1c3a-42a3-8259-6f30b06045a4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:43 devstack sudo[110912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD Aug 26 03:13:43 devstack sudo[110912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:43 devstack sudo[110912]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-600554000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b878c859-4568-4963-b6ef-a6030627c390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c180387fe6d4afe889ad6f9d3789ad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:13:39Z,use_quota=True,user_id='10f4f96856544ccda98696a3d7dc7a7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f266bdb-da31-4542-b68a-f3464c0fe846),volume_type_id=1f266bdb-da31-4542-b68a-f3464c0fe846)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Creating volume b878c859-4568-4963-b6ef-a6030627c390 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:13:43 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:43 devstack sudo[110918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 1073741824 Aug 26 03:13:43 devstack sudo[110918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:43 devstack sudo[110918]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 1073741824" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:43 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 Aug 26 03:13:43 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:44 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Attempting download of 0325af5e-f0cb-4cc4-885f-6cf179981578 ((None, [{'url': 'file:///opt/stack/data/glance/images/0325af5e-f0cb-4cc4-885f-6cf179981578', 'metadata': {}}])) to volume b878c859-4568-4963-b6ef-a6030627c390. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a51ad9-6851-4105-98c6-c8e253df4e5a]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:44 devstack sudo[110927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti Aug 26 03:13:44 devstack sudo[110927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:44 devstack sudo[110927]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti" returned: 0 in 0.332s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:44 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti Aug 26 03:13:44 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:44 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti" returned: 1 in 0.352s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0325af5e-f0cb-4cc4-885f-6cf179981578_ygbct9ti' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:13:45 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[47961000-62e8-4340-8763-28b10f4b59d0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:13:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:45 devstack sudo[110935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD Aug 26 03:13:45 devstack sudo[110935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:45 devstack sudo[110935]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:45 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] 0325af5e-f0cb-4cc4-885f-6cf179981578 was qcow2, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:13:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:45 devstack sudo[110940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 Aug 26 03:13:45 devstack sudo[110940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:47 devstack sudo[110940]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390" returned: 0 in 1.728s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0325af5e-f0cb-4cc4-885f-6cf179981578_gh1qk8atdevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:13:47 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Converted 112.00 MB image at 64.77 MB/s Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:13:47 devstack sudo[110948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 1G Aug 26 03:13:47 devstack sudo[110948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:13:47 devstack sudo[110948]: pam_unix(sudo:session): session closed for user root Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 1G" returned: 0 in 0.318s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Downloaded image 0325af5e-f0cb-4cc4-885f-6cf179981578 ((None, [{'url': 'file:///opt/stack/data/glance/images/0325af5e-f0cb-4cc4-885f-6cf179981578', 'metadata': {}}])) to volume b878c859-4568-4963-b6ef-a6030627c390 successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Temporary image 0325af5e-f0cb-4cc4-885f-6cf179981578 for user 10f4f96856544ccda98696a3d7dc7a7d is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Marking volume b878c859-4568-4963-b6ef-a6030627c390 as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Copying metadata from image 0325af5e-f0cb-4cc4-885f-6cf179981578 to b878c859-4568-4963-b6ef-a6030627c390. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Creating volume glance metadata for volume b878c859-4568-4963-b6ef-a6030627c390 backed by image 0325af5e-f0cb-4cc4-885f-6cf179981578 with: {'image_id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'image_name': 'tempest-scenario-img--2117374373', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c0956e-8eff-4593-acdc-9e8688d78f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b878c859-4568-4963-b6ef-a6030627c390', 'volume_size': 1, 'image_id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0325af5e-f0cb-4cc4-885f-6cf179981578', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2117374373', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '1c180387fe6d4afe889ad6f9d3789ad5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0325af5e-f0cb-4cc4-885f-6cf179981578', 'created_at': datetime.datetime(2026, 8, 26, 1, 13, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 13, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0325af5e-f0cb-4cc4-885f-6cf179981578/file', 'properties': {}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993b223a-48f2-413b-b467-08f89e72484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:13:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Volume volume-b878c859-4568-4963-b6ef-a6030627c390 (b878c859-4568-4963-b6ef-a6030627c390): created successfully Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (993b223a-48f2-413b-b467-08f89e72484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:13:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Flow 'volume_create_manager' (0e0a4564-de5a-4ef4-9b77-09003bf4d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:13:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e2ede410-a23e-4df3-8f96-310dcc823749 tempest-TestInstancesWithCinderVolumes-296739032 None] Created volume successfully. Aug 26 03:13:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-a1893f65-fce2-4f4a-becc-08af6a4f3247 req-27296f7e-f98a-4867-8289-ea5887c21be0 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:13:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-a1893f65-fce2-4f4a-becc-08af6a4f3247 req-27296f7e-f98a-4867-8289-ea5887c21be0 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:13:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-a1893f65-fce2-4f4a-becc-08af6a4f3247 req-27296f7e-f98a-4867-8289-ea5887c21be0 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:13:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-a1893f65-fce2-4f4a-becc-08af6a4f3247 req-27296f7e-f98a-4867-8289-ea5887c21be0 tempest-TestInstancesWithCinderVolumes-296739032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-b878c859-4568-4963-b6ef-a6030627c390', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41bce6a0-4ba4-4cfb-a9da-03e0c9df171e', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:13:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-a1893f65-fce2-4f4a-becc-08af6a4f3247 req-27296f7e-f98a-4867-8289-ea5887c21be0 tempest-TestInstancesWithCinderVolumes-296739032 None] attachment_update completed successfully. Aug 26 03:14:00 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=37,cinder:INSERT=13,cinder:UPDATE=37,cinder:DELETE=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:00 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=39,cinder:SELECT=41,cinder:INSERT=13,cinder:DELETE=4 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:20 devstack sudo[111594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:14:20 devstack sudo[111594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:20 devstack sudo[111594]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.263s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:14:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:14:22 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b3327c19-1d4e-4d73-ac0e-275cd1c3be65 req-52c72dc1-d5a8-4492-b37d-2c528389fc20 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b3327c19-1d4e-4d73-ac0e-275cd1c3be65 req-52c72dc1-d5a8-4492-b37d-2c528389fc20 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b3327c19-1d4e-4d73-ac0e-275cd1c3be65 req-52c72dc1-d5a8-4492-b37d-2c528389fc20 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-b3327c19-1d4e-4d73-ac0e-275cd1c3be65 req-52c72dc1-d5a8-4492-b37d-2c528389fc20 tempest-TestInstancesWithCinderVolumes-296739032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd10cda92-1f81-4e99-b0c0-fde0ec2e82b4', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:14:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-b3327c19-1d4e-4d73-ac0e-275cd1c3be65 req-52c72dc1-d5a8-4492-b37d-2c528389fc20 tempest-TestInstancesWithCinderVolumes-296739032 None] attachment_update completed successfully. Aug 26 03:14:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-0e3a8082-57e5-473d-bced-e5004c2afd4d req-2b528a1a-5a11-4601-bf21-3e7075222834 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-0e3a8082-57e5-473d-bced-e5004c2afd4d req-2b528a1a-5a11-4601-bf21-3e7075222834 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-0e3a8082-57e5-473d-bced-e5004c2afd4d req-2b528a1a-5a11-4601-bf21-3e7075222834 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-0e3a8082-57e5-473d-bced-e5004c2afd4d req-2b528a1a-5a11-4601-bf21-3e7075222834 tempest-TestInstancesWithCinderVolumes-296739032 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b494a029-f413-4da8-8c44-365f1180248e', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:14:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-0e3a8082-57e5-473d-bced-e5004c2afd4d req-2b528a1a-5a11-4601-bf21-3e7075222834 tempest-TestInstancesWithCinderVolumes-296739032 None] attachment_update completed successfully. Aug 26 03:14:31 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-e4abf80c-0515-4277-bb86-4c1ad9ef4525 req-de137019-9e7a-4f78-abe8-2abed832ca8a tempest-TestInstancesWithCinderVolumes-296739032 None] Terminate volume connection completed successfully. Aug 26 03:14:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-e4abf80c-0515-4277-bb86-4c1ad9ef4525 req-de137019-9e7a-4f78-abe8-2abed832ca8a tempest-TestInstancesWithCinderVolumes-296739032 None] Deleting attachment d10cda92-1f81-4e99-b0c0-fde0ec2e82b4. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "cinder-1bcbe6c6-bb79-4505-977e-f514bb89eba8-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-1bcbe6c6-bb79-4505-977e-f514bb89eba8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "cinder-quobyte-1bcbe6c6-bb79-4505-977e-f514bb89eba8" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-quobyte-1bcbe6c6-bb79-4505-977e-f514bb89eba8" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2609ede-27b0-4ea9-b93c-14448a5006b0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:32 devstack sudo[111731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 Aug 26 03:14:32 devstack sudo[111731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:32 devstack sudo[111731]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8" returned: 0 in 0.376s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:32 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8 Aug 26 03:14:32 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:32 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1bcbe6c6-bb79-4505-977e-f514bb89eba8" returned: 0 in 0.240s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-quobyte-1bcbe6c6-bb79-4505-977e-f514bb89eba8" released by "delete_volume" :: held 0.658s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:32 devstack cinder-volume[94506]: WARNING cinder.quota [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174924035-1288974337 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174924035-1288974337, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:14:32 devstack cinder-volume[94506]: WARNING cinder.quota [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174924035-1288974337 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-174924035-1288974337, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:14:32 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Created reservations ['b7f1cd70-9f68-49a6-b17b-8628b85c0523', 'a92ab410-d5ff-48e1-b575-341fe103d7e6', '06e67bd2-a762-4a20-869a-f6bb938c27fc', '89c99501-5547-4a43-bebb-3868a93a2ae6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:33 devstack sudo[111741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:14:33 devstack sudo[111741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:33 devstack sudo[111741]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Deleted volume successfully. Aug 26 03:14:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-36f960cd-42a7-4d9c-a180-4fdfe79ad97b tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-1bcbe6c6-bb79-4505-977e-f514bb89eba8-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-01a456f3-a104-4c80-b9d7-c7e64c193431 req-ade9acc3-ff06-4f0d-bb95-538805972907 tempest-TestInstancesWithCinderVolumes-296739032 None] Terminate volume connection completed successfully. Aug 26 03:14:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-01a456f3-a104-4c80-b9d7-c7e64c193431 req-ade9acc3-ff06-4f0d-bb95-538805972907 tempest-TestInstancesWithCinderVolumes-296739032 None] Deleting attachment b494a029-f413-4da8-8c44-365f1180248e. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "cinder-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "cinder-quobyte-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-quobyte-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e63fdb-fbe6-4fd9-99c0-ed34fa4c7796]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:36 devstack sudo[111770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb Aug 26 03:14:36 devstack sudo[111770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:36 devstack sudo[111770]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb" returned: 0 in 0.392s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:36 devstack sudo[111776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb Aug 26 03:14:36 devstack sudo[111776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:37 devstack sudo[111776]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb" returned: 0 in 0.304s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-quobyte-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb" released by "delete_volume" :: held 0.747s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:37 devstack cinder-volume[94506]: WARNING cinder.quota [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1224600376-303266098 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1224600376-303266098, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:14:37 devstack cinder-volume[94506]: WARNING cinder.quota [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1224600376-303266098 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1224600376-303266098, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Created reservations ['8908ab9d-46c2-4378-9a69-82569615eec0', '3913d5b5-5e6c-421e-8166-7a628941e03d', '84e99a30-aaa0-4db8-8080-ed4353930a9d', '691bb8aa-cf4a-44f9-92e2-11d634b83d4a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:37 devstack sudo[111779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:14:37 devstack sudo[111779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:37 devstack sudo[111779]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Deleted volume successfully. Aug 26 03:14:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97280933-bad2-494b-ba8f-a638c13fbf64 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-1b6f24f1-b8d9-40e3-9fec-2735e78ca6cb-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:14:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Flow 'volume_create_manager' (617a39ac-07ec-4f86-93fb-0aec5c0b5867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:14:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8396845a-951e-497f-8a35-c46f61a4c2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8396845a-951e-497f-8a35-c46f61a4c2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1146575110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02df678-ad1e-4f7c-967d-9adc592e1228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0830bd1879964556b77d8f133b62eb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:40Z,use_quota=True,user_id='d5bbaa0911d24f4da80085f6124f68c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76da1fac-ac39-48d4-b933-f80f6bc954e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76da1fac-ac39-48d4-b933-f80f6bc954e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f561ad7-e947-49f7-90ce-73535b53ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f561ad7-e947-49f7-90ce-73535b53ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b02df678-ad1e-4f7c-967d-9adc592e1228', 'volume_name': 'volume-b02df678-ad1e-4f7c-967d-9adc592e1228', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4308bc3b-ea2c-46d8-959b-a8b68d8ab20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4308bc3b-ea2c-46d8-959b-a8b68d8ab20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba37e192-acf2-4f41-8109-3533662c6ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:14:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Volume b02df678-ad1e-4f7c-967d-9adc592e1228: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b02df678-ad1e-4f7c-967d-9adc592e1228', 'volume_size': 1} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1146575110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b02df678-ad1e-4f7c-967d-9adc592e1228,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0830bd1879964556b77d8f133b62eb3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:14:40Z,use_quota=True,user_id='d5bbaa0911d24f4da80085f6124f68c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Creating volume b02df678-ad1e-4f7c-967d-9adc592e1228 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:14:40 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:40 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 1073741824 Aug 26 03:14:40 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-aac85c83-feef-4ddd-9c3e-3756215a1e57 req-999fe322-c6fe-4a7d-94e0-c6ca9b3e56d4 tempest-TestInstancesWithCinderVolumes-296739032 None] Terminate volume connection completed successfully. Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-aac85c83-feef-4ddd-9c3e-3756215a1e57 req-999fe322-c6fe-4a7d-94e0-c6ca9b3e56d4 tempest-TestInstancesWithCinderVolumes-296739032 None] Deleting attachment 41bce6a0-4ba4-4cfb-a9da-03e0c9df171e. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:14:40 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 1073741824" returned: 0 in 0.536s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:40 devstack sudo[111823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 Aug 26 03:14:40 devstack sudo[111823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:40 devstack sudo[111823]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228" returned: 0 in 0.247s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba37e192-acf2-4f41-8109-3533662c6ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b02df678-ad1e-4f7c-967d-9adc592e1228', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56ec4a8-6735-4d9c-942f-b5e1c2e58cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:14:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Volume volume-b02df678-ad1e-4f7c-967d-9adc592e1228 (b02df678-ad1e-4f7c-967d-9adc592e1228): created successfully Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56ec4a8-6735-4d9c-942f-b5e1c2e58cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:14:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Flow 'volume_create_manager' (617a39ac-07ec-4f86-93fb-0aec5c0b5867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:14:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-dfb64368-0c28-4ab1-baae-32eeaa3d7f77 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Created volume successfully. Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "cinder-b878c859-4568-4963-b6ef-a6030627c390-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-b878c859-4568-4963-b6ef-a6030627c390-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "cinder-quobyte-b878c859-4568-4963-b6ef-a6030627c390" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-quobyte-b878c859-4568-4963-b6ef-a6030627c390" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0f8d7e-602e-4342-90f6-417db7f103e2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:41 devstack sudo[111826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 Aug 26 03:14:41 devstack sudo[111826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:41 devstack sudo[111826]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390" returned: 0 in 0.381s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:41 devstack sudo[111831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390 Aug 26 03:14:41 devstack sudo[111831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:42 devstack sudo[111831]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b878c859-4568-4963-b6ef-a6030627c390" returned: 0 in 0.244s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-quobyte-b878c859-4568-4963-b6ef-a6030627c390" released by "delete_volume" :: held 0.663s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:42 devstack cinder-volume[94506]: WARNING cinder.quota [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907362940-2011193623 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907362940-2011193623, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:14:42 devstack cinder-volume[94506]: WARNING cinder.quota [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907362940-2011193623 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1907362940-2011193623, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Created reservations ['cf0956a5-5f44-41ce-96c7-8d358d8b67f4', '1f5bcc6a-a294-446e-b7e6-3b30e19970fe', '2c3dad12-ee03-4899-aaa4-82928892f5f9', 'af7f4a07-1693-442c-965d-56c654d7a274'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:42 devstack sudo[111837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:14:42 devstack sudo[111837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:42 devstack sudo[111837]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Deleted volume successfully. Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-52cf7360-2253-44e0-977e-6a7b83a7d687 tempest-TestInstancesWithCinderVolumes-296739032 None] Lock "cinder-b878c859-4568-4963-b6ef-a6030627c390-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-7e4c0be8-1f2e-44fa-87db-78a3e64bcda3 req-1381da5b-42bd-4285-8e49-1582c76efd07 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-7e4c0be8-1f2e-44fa-87db-78a3e64bcda3 req-1381da5b-42bd-4285-8e49-1582c76efd07 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-7e4c0be8-1f2e-44fa-87db-78a3e64bcda3 req-1381da5b-42bd-4285-8e49-1582c76efd07 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-7e4c0be8-1f2e-44fa-87db-78a3e64bcda3 req-1381da5b-42bd-4285-8e49-1582c76efd07 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-b02df678-ad1e-4f7c-967d-9adc592e1228', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dbee6d37-670d-4bd4-a11c-d1e0449b674d', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:14:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-7e4c0be8-1f2e-44fa-87db-78a3e64bcda3 req-1381da5b-42bd-4285-8e49-1582c76efd07 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] attachment_update completed successfully. Aug 26 03:14:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-4b7d8417-85a4-4886-8e80-3c6f06f42bd7 req-7e2c7ec3-9cbb-4185-ad27-089feb033720 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Terminate volume connection completed successfully. Aug 26 03:14:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-4b7d8417-85a4-4886-8e80-3c6f06f42bd7 req-7e2c7ec3-9cbb-4185-ad27-089feb033720 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Deleting attachment dbee6d37-670d-4bd4-a11c-d1e0449b674d. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:14:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Acquiring lock "cinder-b02df678-ad1e-4f7c-967d-9adc592e1228-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "cinder-b02df678-ad1e-4f7c-967d-9adc592e1228-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Acquiring lock "cinder-quobyte-b02df678-ad1e-4f7c-967d-9adc592e1228" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:14:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "cinder-quobyte-b02df678-ad1e-4f7c-967d-9adc592e1228" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:14:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc01a293-672b-4e06-a2b9-9da500622a1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:14:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:46 devstack sudo[112265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 Aug 26 03:14:46 devstack sudo[112265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:47 devstack sudo[112265]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228" returned: 0 in 0.404s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:47 devstack sudo[112270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228 Aug 26 03:14:47 devstack sudo[112270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:47 devstack sudo[112270]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b02df678-ad1e-4f7c-967d-9adc592e1228" returned: 0 in 0.252s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "cinder-quobyte-b02df678-ad1e-4f7c-967d-9adc592e1228" released by "delete_volume" :: held 0.711s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Created reservations ['f815cf15-f12c-49ea-b5ad-999998c9cc4e', '2d2ff233-39e8-4de8-aef5-44834b1c23d5', 'b8f46672-3a86-44ef-9b8a-9b3e0f4e87b0', 'd12ca824-e098-424e-ae3c-737dab9c6430'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:14:47 devstack sudo[112274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:14:47 devstack sudo[112274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:14:47 devstack sudo[112274]: pam_unix(sudo:session): session closed for user root Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:14:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Deleted volume successfully. Aug 26 03:14:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d35a2b0d-e134-4e8b-ba90-a07477e8f981 tempest-TestServerVolumeAttachScenarioOldVersion-653820823 None] Lock "cinder-b02df678-ad1e-4f7c-967d-9adc592e1228-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:14:57 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=44,cinder:UPDATE=40,cinder:INSERT=6,cinder:DELETE=3 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:14:57 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=47,cinder:UPDATE=39,cinder:INSERT=11,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Flow 'volume_create_manager' (710c3f4f-b740-420a-ba64-71edcf9f8095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f54bde-14ff-4495-8878-4901707f135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f54bde-14ff-4495-8878-4901707f135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2081027443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e107a7-afce-4845-961f-1b3a5315a4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47820d50a0c047ee800cba3d17995804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:19Z,use_quota=True,user_id='967792d836b6465685fd7b3eb096ed64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a22b7b-17f2-49a8-a4f5-9b21c8b58d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a22b7b-17f2-49a8-a4f5-9b21c8b58d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9405a1d1-fe49-4cea-b44c-73a1e768a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9405a1d1-fe49-4cea-b44c-73a1e768a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7e107a7-afce-4845-961f-1b3a5315a4cc', 'volume_name': 'volume-c7e107a7-afce-4845-961f-1b3a5315a4cc', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90037640-89fe-48c5-a391-5f89b45682b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90037640-89fe-48c5-a391-5f89b45682b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ace558a-6f76-4eb5-8af2-0173c5a8692d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Volume c7e107a7-afce-4845-961f-1b3a5315a4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7e107a7-afce-4845-961f-1b3a5315a4cc', 'volume_size': 1} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-2081027443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7e107a7-afce-4845-961f-1b3a5315a4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47820d50a0c047ee800cba3d17995804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:19Z,use_quota=True,user_id='967792d836b6465685fd7b3eb096ed64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Creating volume c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:15:19 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:19 devstack sudo[112324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc 1073741824 Aug 26 03:15:19 devstack sudo[112324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:19 devstack sudo[112324]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc 1073741824" returned: 0 in 0.458s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:20 devstack sudo[112333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc Aug 26 03:15:20 devstack sudo[112333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:20 devstack sudo[112333]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc" returned: 0 in 0.259s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ace558a-6f76-4eb5-8af2-0173c5a8692d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7e107a7-afce-4845-961f-1b3a5315a4cc', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19c68e9-c47f-40b4-8feb-ce5cb6aed057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Volume volume-c7e107a7-afce-4845-961f-1b3a5315a4cc (c7e107a7-afce-4845-961f-1b3a5315a4cc): created successfully Aug 26 03:15:20 devstack sudo[112336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:15:20 devstack sudo[112336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c19c68e9-c47f-40b4-8feb-ce5cb6aed057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Flow 'volume_create_manager' (710c3f4f-b740-420a-ba64-71edcf9f8095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:15:20 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-195bd26e-fa99-4db2-94c7-ac3db918768f tempest-TestImageHashVerification-1829697840 None] Created volume successfully. Aug 26 03:15:20 devstack sudo[112336]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.257s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:15:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b467cb4-ba14-40c2-9f23-4f8ba37b0c99]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:22 devstack sudo[112339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc Aug 26 03:15:22 devstack sudo[112339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:22 devstack sudo[112339]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc" returned: 0 in 0.358s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[19987317-5497-4942-a125-ad9a480bbb39]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:22 devstack sudo[112344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc Aug 26 03:15:22 devstack sudo[112344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:23 devstack sudo[112344]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc" returned: 0 in 0.490s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc /opt/stack/data/cinder/conversion/c7e107a7-afce-4845-961f-1b3a5315a4cc.temp_image.ce6b2b49-fd1c-4b99-a38a-834cf1357513_fcwssko.img {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:23 devstack sudo[112349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc /opt/stack/data/cinder/conversion/c7e107a7-afce-4845-961f-1b3a5315a4cc.temp_image.ce6b2b49-fd1c-4b99-a38a-834cf1357513_fcwssko.img Aug 26 03:15:23 devstack sudo[112349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:27 devstack sudo[112349]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc /opt/stack/data/cinder/conversion/c7e107a7-afce-4845-961f-1b3a5315a4cc.temp_image.ce6b2b49-fd1c-4b99-a38a-834cf1357513_fcwssko.img" returned: 0 in 4.714s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3552b1e1-8645-4a22-8199-8c68338c0765]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:28 devstack sudo[112398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc Aug 26 03:15:28 devstack sudo[112398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:28 devstack sudo[112398]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc" returned: 0 in 0.527s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:28 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc, size 1024.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/conversion/c7e107a7-afce-4845-961f-1b3a5315a4cc.temp_image.ce6b2b49-fd1c-4b99-a38a-834cf1357513_fcwssko.img {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:15:28 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Converted 1024.00 MB image at 217.16 MB/s Aug 26 03:15:28 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] ce6b2b49-fd1c-4b99-a38a-834cf1357513 was raw, no need to convert to raw {{(pid=94506) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Flow 'volume_create_manager' (dfeb725a-88d1-41f4-bfa8-0245ba52bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e6bf67-642e-41fe-ac6e-384192c83723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6e6bf67-642e-41fe-ac6e-384192c83723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1093144525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6d9854-593a-4dc4-af49-6895ca2d0305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dd26b8ec894934ad3ff8de00e42262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:34Z,use_quota=True,user_id='31cb46caa8114f9aa8454013c24695a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37838d68-b6cd-4ef7-81b6-c07fa587e839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37838d68-b6cd-4ef7-81b6-c07fa587e839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97db8293-a333-45fd-84a5-e24bf047fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97db8293-a333-45fd-84a5-e24bf047fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6d9854-593a-4dc4-af49-6895ca2d0305', 'volume_name': 'volume-4a6d9854-593a-4dc4-af49-6895ca2d0305', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6949e9-a2ec-45af-9dff-88a7e5920bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad6949e9-a2ec-45af-9dff-88a7e5920bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d315b7-178c-40fc-ad62-de0d9e80f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Volume 4a6d9854-593a-4dc4-af49-6895ca2d0305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6d9854-593a-4dc4-af49-6895ca2d0305', 'volume_size': 1} Aug 26 03:15:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:43 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:43 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.244s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Uploaded volume to glance image-id: ce6b2b49-fd1c-4b99-a38a-834cf1357513. {{(pid=94506) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.653s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1093144525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6d9854-593a-4dc4-af49-6895ca2d0305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dd26b8ec894934ad3ff8de00e42262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:15:34Z,use_quota=True,user_id='31cb46caa8114f9aa8454013c24695a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Creating volume 4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:15:50 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:50 devstack sudo[112509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 1073741824 Aug 26 03:15:50 devstack sudo[112509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:50 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9acc7c3d-c2e0-4284-a49f-001325f9bac3 tempest-TestImageHashVerification-1829697840 None] Copy volume to image completed successfully. Aug 26 03:15:50 devstack sudo[112509]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 1073741824" returned: 0 in 0.428s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:51 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 Aug 26 03:15:51 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:51 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305" returned: 0 in 0.234s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d315b7-178c-40fc-ad62-de0d9e80f750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6d9854-593a-4dc4-af49-6895ca2d0305', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeb855d-d7aa-4d5b-b044-c745dc1735de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:15:51 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Volume volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 (4a6d9854-593a-4dc4-af49-6895ca2d0305): created successfully Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeb855d-d7aa-4d5b-b044-c745dc1735de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:15:51 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Flow 'volume_create_manager' (dfeb725a-88d1-41f4-bfa8-0245ba52bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:15:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a5c19be9-daee-4ec6-a7f2-c5001a3617a0 tempest-TestStampPattern-471549970 None] Created volume successfully. Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Acquiring lock "cinder-c7e107a7-afce-4845-961f-1b3a5315a4cc-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Lock "cinder-c7e107a7-afce-4845-961f-1b3a5315a4cc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Acquiring lock "cinder-quobyte-c7e107a7-afce-4845-961f-1b3a5315a4cc" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Lock "cinder-quobyte-c7e107a7-afce-4845-961f-1b3a5315a4cc" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4958ed8b-40dc-4f2a-aa79-239384469870]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:52 devstack sudo[112517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc Aug 26 03:15:52 devstack sudo[112517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:52 devstack sudo[112517]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc" returned: 0 in 0.375s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:52 devstack sudo[112522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc Aug 26 03:15:52 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:52 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7e107a7-afce-4845-961f-1b3a5315a4cc" returned: 0 in 0.251s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Lock "cinder-quobyte-c7e107a7-afce-4845-961f-1b3a5315a4cc" released by "delete_volume" :: held 0.671s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Created reservations ['e3bf627f-fca1-44a6-87c5-55a22cbb3c7d', 'b29ebdf3-3e49-4250-83d9-c90abe4391e4', '5274a45b-960b-4e7e-a128-af7d00e3a57f', '77232e5c-3029-4f94-95b4-fc62db0da697'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:15:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:15:53 devstack sudo[112525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:15:53 devstack sudo[112525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:15:53 devstack sudo[112525]: pam_unix(sudo:session): session closed for user root Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:15:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Deleted volume successfully. Aug 26 03:15:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d986a148-b45a-4b7b-8a87-1e785f70edc7 tempest-TestImageHashVerification-1829697840 None] Lock "cinder-c7e107a7-afce-4845-961f-1b3a5315a4cc-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:02 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=5,cinder:UPDATE=13,cinder:INSERT=1 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:16:03 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Flow 'volume_create_manager' (724929e4-9936-4a36-9c50-b95c650e82b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716ce3b0-c88e-478e-b832-c79ac265a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (716ce3b0-c88e-478e-b832-c79ac265a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-747698521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafceeff-a816-4a7f-845f-584c448af89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53269d9013004297b8c968456aa7390f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:06Z,use_quota=True,user_id='df64853589ee48b787dfe489ed63d79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5da3bc-d43e-4a64-8d96-e16bc8185ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb5da3bc-d43e-4a64-8d96-e16bc8185ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a8ff8-30b7-4845-9032-652b64643019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a8ff8-30b7-4845-9032-652b64643019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fafceeff-a816-4a7f-845f-584c448af89a', 'volume_name': 'volume-fafceeff-a816-4a7f-845f-584c448af89a', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67eea30-a8bb-4a16-ae3f-d7fb9e9ccc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67eea30-a8bb-4a16-ae3f-d7fb9e9ccc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866a9630-70f3-4578-9b44-cccb61174eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Volume fafceeff-a816-4a7f-845f-584c448af89a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fafceeff-a816-4a7f-845f-584c448af89a', 'volume_size': 1} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-747698521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fafceeff-a816-4a7f-845f-584c448af89a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53269d9013004297b8c968456aa7390f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:06Z,use_quota=True,user_id='df64853589ee48b787dfe489ed63d79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Creating volume fafceeff-a816-4a7f-845f-584c448af89a {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:05 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:05 devstack sudo[112565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a 1073741824 Aug 26 03:16:05 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b556a231-da35-404b-8bf3-4716ce5ca519 req-e2b251dc-bd24-406c-b48c-5b087f67757f tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:06 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a 1073741824" returned: 0 in 0.454s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:06 devstack sudo[112579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a Aug 26 03:16:06 devstack sudo[112579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:06 devstack sudo[112579]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b556a231-da35-404b-8bf3-4716ce5ca519 req-e2b251dc-bd24-406c-b48c-5b087f67757f tempest-TestStampPattern-471549970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.545s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866a9630-70f3-4578-9b44-cccb61174eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fafceeff-a816-4a7f-845f-584c448af89a', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8d7638-4daf-467b-bae1-ec197523fff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-b556a231-da35-404b-8bf3-4716ce5ca519 req-e2b251dc-bd24-406c-b48c-5b087f67757f tempest-TestStampPattern-471549970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:06 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Volume volume-fafceeff-a816-4a7f-845f-584c448af89a (fafceeff-a816-4a7f-845f-584c448af89a): created successfully Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff8d7638-4daf-467b-bae1-ec197523fff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Flow 'volume_create_manager' (724929e4-9936-4a36-9c50-b95c650e82b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-da26de44-cd00-4a18-a31c-77e9105bfafd tempest-ProjectReaderTests-362293179 None] Created volume successfully. Aug 26 03:16:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-b556a231-da35-404b-8bf3-4716ce5ca519 req-e2b251dc-bd24-406c-b48c-5b087f67757f tempest-TestStampPattern-471549970 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-4a6d9854-593a-4dc4-af49-6895ca2d0305', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0796a3bf-8d45-4133-aee3-b506fba4ed5d', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:16:06 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-b556a231-da35-404b-8bf3-4716ce5ca519 req-e2b251dc-bd24-406c-b48c-5b087f67757f tempest-TestStampPattern-471549970 None] attachment_update completed successfully. Aug 26 03:16:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Acquiring lock "cinder-fafceeff-a816-4a7f-845f-584c448af89a-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Lock "cinder-fafceeff-a816-4a7f-845f-584c448af89a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Acquiring lock "cinder-quobyte-fafceeff-a816-4a7f-845f-584c448af89a" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Lock "cinder-quobyte-fafceeff-a816-4a7f-845f-584c448af89a" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:07 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e2d07-7e31-4e57-8900-87537c449cef]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:08 devstack sudo[112969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a Aug 26 03:16:08 devstack sudo[112969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:08 devstack sudo[112969]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a" returned: 0 in 0.366s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:08 devstack sudo[112982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a Aug 26 03:16:08 devstack sudo[112982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:08 devstack sudo[112982]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-fafceeff-a816-4a7f-845f-584c448af89a" returned: 0 in 0.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Lock "cinder-quobyte-fafceeff-a816-4a7f-845f-584c448af89a" released by "delete_volume" :: held 0.688s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Created reservations ['aed2cffa-8acc-42c1-8779-5bc875131eb8', '32c43874-9425-4c05-8329-a09524415ed1', '3eed0070-44be-40a7-a2cb-ca69b121d1b8', 'a79f0b4f-75d8-464d-af0c-1c5d0fd199e3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:08 devstack sudo[112985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:08 devstack sudo[112985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:08 devstack sudo[112985]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.241s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Deleted volume successfully. Aug 26 03:16:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-37ceb3da-c4c1-4444-885f-bf98fcbc4134 tempest-ProjectReaderTests-362293179 None] Lock "cinder-fafceeff-a816-4a7f-845f-584c448af89a-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Flow 'volume_create_manager' (3158a4d4-0dec-4c29-925b-50ff5870653c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d4e7e-c142-441c-ba78-8d3853a23467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b62d4e7e-c142-441c-ba78-8d3853a23467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278346117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d7b24f-9001-4b04-a8c0-210a9669fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53269d9013004297b8c968456aa7390f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:09Z,use_quota=True,user_id='df64853589ee48b787dfe489ed63d79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fef901-1007-4125-86eb-cca188c0ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fef901-1007-4125-86eb-cca188c0ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2181e1fb-d6f7-4e93-9001-050e763a7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2181e1fb-d6f7-4e93-9001-050e763a7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d7b24f-9001-4b04-a8c0-210a9669fb2c', 'volume_name': 'volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b36e85-7e9a-43ee-8e34-458622b800d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21b36e85-7e9a-43ee-8e34-458622b800d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8119b0bd-e637-4bfc-a42f-3edb0bba6e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:09 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Volume 34d7b24f-9001-4b04-a8c0-210a9669fb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c', 'volume_size': 1} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278346117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d7b24f-9001-4b04-a8c0-210a9669fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53269d9013004297b8c968456aa7390f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:09Z,use_quota=True,user_id='df64853589ee48b787dfe489ed63d79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Creating volume 34d7b24f-9001-4b04-a8c0-210a9669fb2c {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:09 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:09 devstack sudo[112988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c 1073741824 Aug 26 03:16:09 devstack sudo[112988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:09 devstack sudo[112988]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c 1073741824" returned: 0 in 0.459s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:10 devstack sudo[112997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c Aug 26 03:16:10 devstack sudo[112997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:10 devstack sudo[112997]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8119b0bd-e637-4bfc-a42f-3edb0bba6e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa8874-06ad-4c22-ae0b-c38182fb1064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:10 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Volume volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c (34d7b24f-9001-4b04-a8c0-210a9669fb2c): created successfully Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5aa8874-06ad-4c22-ae0b-c38182fb1064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Flow 'volume_create_manager' (3158a4d4-0dec-4c29-925b-50ff5870653c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-35b57b39-3913-4766-a716-5231b6e8427c tempest-ProjectReaderTests-362293179 None] Created volume successfully. Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Acquiring lock "cinder-34d7b24f-9001-4b04-a8c0-210a9669fb2c-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Lock "cinder-34d7b24f-9001-4b04-a8c0-210a9669fb2c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Acquiring lock "cinder-quobyte-34d7b24f-9001-4b04-a8c0-210a9669fb2c" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Lock "cinder-quobyte-34d7b24f-9001-4b04-a8c0-210a9669fb2c" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a106fe-7056-45c7-b005-00cd5fb68600]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:10 devstack sudo[113009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c Aug 26 03:16:10 devstack sudo[113009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:10 devstack sudo[113009]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:10 devstack sudo[113016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c Aug 26 03:16:10 devstack sudo[113016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:11 devstack sudo[113016]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-34d7b24f-9001-4b04-a8c0-210a9669fb2c" returned: 0 in 0.245s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Lock "cinder-quobyte-34d7b24f-9001-4b04-a8c0-210a9669fb2c" released by "delete_volume" :: held 0.654s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Created reservations ['bac50bb8-b484-4a3b-acd6-a520395e085e', 'e588b6f1-12f1-4dbb-9db2-981c9b12fe9c', 'b72e1a34-80a6-41f1-b739-d486f0edfe8a', '76136b11-ccd3-4fd6-b42d-e9967d88bf09'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-2867c87c-37f5-4caf-b17a-35e3b68bfcee req-bc92770e-1514-47fc-8823-1fbe1b8505e8 tempest-TestStampPattern-471549970 None] Terminate volume connection completed successfully. Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-2867c87c-37f5-4caf-b17a-35e3b68bfcee req-bc92770e-1514-47fc-8823-1fbe1b8505e8 tempest-TestStampPattern-471549970 None] Deleting attachment 0796a3bf-8d45-4133-aee3-b506fba4ed5d. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:11 devstack sudo[113049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:11 devstack sudo[113049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:11 devstack sudo[113049]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.228s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Deleted volume successfully. Aug 26 03:16:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac11c981-472c-4f21-ad4e-bcce13ccfaa1 tempest-ProjectReaderTests-362293179 None] Lock "cinder-34d7b24f-9001-4b04-a8c0-210a9669fb2c-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Creating offline snapshot 3af0db91-6154-405d-8931-6664674dce3d of volume 4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec0f71c-f3b3-43ed-9efe-ce50fa4efffd]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:12 devstack sudo[113052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 Aug 26 03:16:12 devstack sudo[113052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:12 devstack sudo[113052]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305" returned: 0 in 0.397s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:12 devstack sudo[113057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d 1G Aug 26 03:16:12 devstack sudo[113057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[113057]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d 1G" returned: 0 in 0.409s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[113062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d Aug 26 03:16:13 devstack sudo[113062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[113062]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d" returned: 0 in 0.334s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d is being set with open permissions: ugo+rw Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[113069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d Aug 26 03:16:13 devstack sudo[113069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[113069]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d" returned: 0 in 0.238s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[113072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info Aug 26 03:16:13 devstack sudo[113072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:13 devstack sudo[113072]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info" returned: 0 in 0.249s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:13 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info is being set with open permissions: ugo+rw Aug 26 03:16:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:13 devstack sudo[113075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info Aug 26 03:16:13 devstack sudo[113075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:14 devstack sudo[113075]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.info" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2bb84c8b-f7a5-4c54-bf2c-62d714e3bc63 tempest-TestStampPattern-471549970 None] Create snapshot completed successfully Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (15dc5910-1e63-4916-a8d0-6ae0e55fadb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb45565-8831-40d4-9ec2-e109e972a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb45565-8831-40d4-9ec2-e109e972a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091913923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6ab878-5662-471f-a6d7-e49456db00d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:20Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ea9efb-eb5c-4718-a0ba-8f45dad74ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ea9efb-eb5c-4718-a0ba-8f45dad74ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ecfb00-56ab-442b-a382-c71f80d1043a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ecfb00-56ab-442b-a382-c71f80d1043a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6ab878-5662-471f-a6d7-e49456db00d4', 'volume_name': 'volume-dc6ab878-5662-471f-a6d7-e49456db00d4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33387c2-fefb-420c-af28-8a7eebb9b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a33387c2-fefb-420c-af28-8a7eebb9b277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f117c-f7e8-4010-8938-5b807b4beb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Volume dc6ab878-5662-471f-a6d7-e49456db00d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6ab878-5662-471f-a6d7-e49456db00d4', 'volume_size': 1} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2091913923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6ab878-5662-471f-a6d7-e49456db00d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:20Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Creating volume dc6ab878-5662-471f-a6d7-e49456db00d4 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:20 devstack sudo[113125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 1073741824 Aug 26 03:16:20 devstack sudo[113125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:20 devstack sudo[113126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:20 devstack sudo[113126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:20 devstack sudo[113126]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:16:20 devstack sudo[113125]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 1073741824" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:20 devstack sudo[113134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 Aug 26 03:16:20 devstack sudo[113134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:21 devstack sudo[113134]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4" returned: 0 in 0.302s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639f117c-f7e8-4010-8938-5b807b4beb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6ab878-5662-471f-a6d7-e49456db00d4', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a112d8-bee6-43b6-b461-36f9096bd631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Volume volume-dc6ab878-5662-471f-a6d7-e49456db00d4 (dc6ab878-5662-471f-a6d7-e49456db00d4): created successfully Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a112d8-bee6-43b6-b461-36f9096bd631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (15dc5910-1e63-4916-a8d0-6ae0e55fadb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Flow 'volume_create_manager' (d1d2865f-73e2-49c7-b180-afd2d5570ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2590324-23b9-4c5c-8403-94e7f43b0782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2590324-23b9-4c5c-8403-94e7f43b0782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-244975509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0968ade0-92b9-40c5-8277-b8585cf28b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07dd26b8ec894934ad3ff8de00e42262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3af0db91-6154-405d-8931-6664674dce3d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:21Z,use_quota=True,user_id='31cb46caa8114f9aa8454013c24695a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a7118a-338a-4ff4-ad1e-23d0f9260117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16a7118a-338a-4ff4-ad1e-23d0f9260117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75423548-ecfb-41d0-9295-6db1f18b7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75423548-ecfb-41d0-9295-6db1f18b7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0968ade0-92b9-40c5-8277-b8585cf28b2a', 'volume_name': 'volume-0968ade0-92b9-40c5-8277-b8585cf28b2a', 'volume_size': 1, 'snapshot_id': '3af0db91-6154-405d-8931-6664674dce3d'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c74af6-b9d2-4195-9a8c-d9ba7d2e79eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c74af6-b9d2-4195-9a8c-d9ba7d2e79eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83761ed3-a9b8-450c-a747-d2d4196476a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Volume 0968ade0-92b9-40c5-8277-b8585cf28b2a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0968ade0-92b9-40c5-8277-b8585cf28b2a', 'volume_size': 1, 'snapshot_id': '3af0db91-6154-405d-8931-6664674dce3d'} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-quobyte-3af0db91-6154-405d-8931-6664674dce3d-0968ade0-92b9-40c5-8277-b8585cf28b2a" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-95994da1-4260-4753-8b46-12ebbbaa4199 tempest-ProjectReaderTests-1859696638 None] Created volume successfully. Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-3af0db91-6154-405d-8931-6664674dce3d-0968ade0-92b9-40c5-8277-b8585cf28b2a" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Creating volume 0968ade0-92b9-40c5-8277-b8585cf28b2a from snapshot 3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-quobyte-0968ade0-92b9-40c5-8277-b8585cf28b2a" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-0968ade0-92b9-40c5-8277-b8585cf28b2a" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] snapshot: 3af0db91-6154-405d-8931-6664674dce3d, volume: 0968ade0-92b9-40c5-8277-b8585cf28b2a, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b248df-27b1-4bc7-9ca4-100ca34dfb22]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:21 devstack sudo[113137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d Aug 26 03:16:21 devstack sudo[113137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:21 devstack sudo[113137]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a6d9854-593a-4dc4-af49-6895ca2d0305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1417770-a18a-48af-b833-cd290964c976]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:21 devstack sudo[113143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 Aug 26 03:16:21 devstack sudo[113143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:22 devstack sudo[113143]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305" returned: 0 in 0.389s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:22 devstack sudo[113151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a Aug 26 03:16:22 devstack sudo[113151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-dc6ab878-5662-471f-a6d7-e49456db00d4-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-dc6ab878-5662-471f-a6d7-e49456db00d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-quobyte-dc6ab878-5662-471f-a6d7-e49456db00d4" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-dc6ab878-5662-471f-a6d7-e49456db00d4" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1366f339-11de-47d5-8357-2a534cee52b2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:22 devstack sudo[113157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 Aug 26 03:16:22 devstack sudo[113157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:23 devstack sudo[113157]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4" returned: 0 in 0.576s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:23 devstack sudo[113168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4 Aug 26 03:16:23 devstack sudo[113168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:23 devstack sudo[113168]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dc6ab878-5662-471f-a6d7-e49456db00d4" returned: 0 in 0.686s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-dc6ab878-5662-471f-a6d7-e49456db00d4" released by "delete_volume" :: held 1.327s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Created reservations ['f851c028-c3bd-46ea-8141-c18e4e49d5d9', '6368f899-cefd-4a1e-b5c1-6c623e6df3b3', '45f3e1ac-4c46-4da3-b5f8-20b45bf259a5', '5853ffbd-84b8-4cf2-9c99-e963209966ce'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:24 devstack sudo[113172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:24 devstack sudo[113172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:25 devstack sudo[113172]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.825s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:25 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Deleted volume successfully. Aug 26 03:16:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac462f20-bbab-42c4-9fea-6e6b9cad5a31 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-dc6ab878-5662-471f-a6d7-e49456db00d4-delete_volume" released by "delete_volume" :: held 2.692s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (2b83f68e-8dfe-4a8d-8c35-4f1e1dabbfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ca2f98-5e23-490a-96bd-aca735f1ec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ca2f98-5e23-490a-96bd-aca735f1ec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110270305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea87af8-e407-46d8-9964-67372f8213d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:27Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77bba1b-5a3b-4250-84d3-e00941cfb33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77bba1b-5a3b-4250-84d3-e00941cfb33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e57180-81ed-4768-be79-a9bfd36d3962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6e57180-81ed-4768-be79-a9bfd36d3962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea87af8-e407-46d8-9964-67372f8213d1', 'volume_name': 'volume-cea87af8-e407-46d8-9964-67372f8213d1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de295375-dc86-42bf-be10-f0651e53b666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de295375-dc86-42bf-be10-f0651e53b666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662f682f-4d81-4672-9b12-ae6f5aa6db6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Volume cea87af8-e407-46d8-9964-67372f8213d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea87af8-e407-46d8-9964-67372f8213d1', 'volume_size': 1} Aug 26 03:16:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:28 devstack sudo[113151]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a" returned: 0 in 6.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305, size 1024.00 MB, duration 6.26 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:16:28 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Converted 1024.00 MB image at 163.51 MB/s Aug 26 03:16:28 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a is being set with open permissions: ugo+rw Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:28 devstack sudo[113213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a Aug 26 03:16:28 devstack sudo[113213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:28 devstack sudo[113213]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a" returned: 0 in 0.301s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-0968ade0-92b9-40c5-8277-b8585cf28b2a" released by "_copy_volume_from_snapshot" :: held 7.384s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-3af0db91-6154-405d-8931-6664674dce3d-0968ade0-92b9-40c5-8277-b8585cf28b2a" released by "_create_volume_from_snapshot" :: held 7.459s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.478s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2110270305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cea87af8-e407-46d8-9964-67372f8213d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:27Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Creating volume cea87af8-e407-46d8-9964-67372f8213d1 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:28 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:28 devstack sudo[113226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 1073741824 Aug 26 03:16:28 devstack sudo[113226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83761ed3-a9b8-450c-a747-d2d4196476a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0968ade0-92b9-40c5-8277-b8585cf28b2a', 'volume_size': 1, 'snapshot_id': '3af0db91-6154-405d-8931-6664674dce3d'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735d65c-473e-4295-8dba-c0873eccb922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:28 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Volume volume-0968ade0-92b9-40c5-8277-b8585cf28b2a (0968ade0-92b9-40c5-8277-b8585cf28b2a): created successfully Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735d65c-473e-4295-8dba-c0873eccb922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:28 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Flow 'volume_create_manager' (d1d2865f-73e2-49c7-b180-afd2d5570ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-730f5444-a459-4b18-9ef3-e46fbd8c7ad3 tempest-TestStampPattern-471549970 None] Created volume successfully. Aug 26 03:16:29 devstack sudo[113226]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 1073741824" returned: 0 in 0.574s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:29 devstack sudo[113245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 Aug 26 03:16:29 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:29 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (662f682f-4d81-4672-9b12-ae6f5aa6db6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea87af8-e407-46d8-9964-67372f8213d1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d7a090-8d14-4365-8a2d-c879aaf6e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:29 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Volume volume-cea87af8-e407-46d8-9964-67372f8213d1 (cea87af8-e407-46d8-9964-67372f8213d1): created successfully Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d7a090-8d14-4365-8a2d-c879aaf6e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (2b83f68e-8dfe-4a8d-8c35-4f1e1dabbfc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:29 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-84918bc0-d642-4f97-859a-424676205336 tempest-ProjectReaderTests-1859696638 None] Created volume successfully. Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-cea87af8-e407-46d8-9964-67372f8213d1-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-cea87af8-e407-46d8-9964-67372f8213d1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-quobyte-cea87af8-e407-46d8-9964-67372f8213d1" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-cea87af8-e407-46d8-9964-67372f8213d1" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[88883a9b-32e6-44ce-858b-d12cdf878a94]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:31 devstack sudo[113305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 Aug 26 03:16:31 devstack sudo[113305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:31 devstack sudo[113305]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1" returned: 0 in 0.356s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:31 devstack sudo[113311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1 Aug 26 03:16:31 devstack sudo[113311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:31 devstack sudo[113311]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-cea87af8-e407-46d8-9964-67372f8213d1" returned: 0 in 0.232s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-cea87af8-e407-46d8-9964-67372f8213d1" released by "delete_volume" :: held 0.629s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Created reservations ['276c84f0-d682-424b-b007-edc9f4bc0a04', '8b489409-665e-4721-ace9-05a0e9022841', '1250a34d-ebbe-4c7e-8729-b7e98cb24ffa', 'b3dec498-3163-48a0-a19e-4a69386f267a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:31 devstack sudo[113315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:31 devstack sudo[113315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:32 devstack sudo[113315]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.453s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Deleted volume successfully. Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4ba4722-c8a1-49e3-b6dd-74ff92b46175 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-cea87af8-e407-46d8-9964-67372f8213d1-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (ce50b05e-0b26-479a-83fc-f6aba4606556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487b2adf-59e3-4ccc-9c4a-1d696f7fd1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (487b2adf-59e3-4ccc-9c4a-1d696f7fd1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148093108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdc947c-94e8-42a0-89b6-1d207035b060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:33Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611d888d-da1e-43f6-a30d-fda6cfa944c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611d888d-da1e-43f6-a30d-fda6cfa944c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd4ed43-88db-4974-9585-b93b4dae99c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd4ed43-88db-4974-9585-b93b4dae99c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fdc947c-94e8-42a0-89b6-1d207035b060', 'volume_name': 'volume-1fdc947c-94e8-42a0-89b6-1d207035b060', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade70380-b823-4beb-bf96-3b2e8505813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ade70380-b823-4beb-bf96-3b2e8505813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691ef599-2137-4bc8-968a-06e8a4519dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Volume 1fdc947c-94e8-42a0-89b6-1d207035b060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fdc947c-94e8-42a0-89b6-1d207035b060', 'volume_size': 1} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1148093108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fdc947c-94e8-42a0-89b6-1d207035b060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:33Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Creating volume 1fdc947c-94e8-42a0-89b6-1d207035b060 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:32 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:16:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:32 devstack sudo[113319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 1073741824 Aug 26 03:16:32 devstack sudo[113319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:33 devstack sudo[113319]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 1073741824" returned: 0 in 0.445s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:33 devstack sudo[113324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 Aug 26 03:16:33 devstack sudo[113324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:33 devstack sudo[113324]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (691ef599-2137-4bc8-968a-06e8a4519dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fdc947c-94e8-42a0-89b6-1d207035b060', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fee0a1-f530-447f-9efe-4bb15b5e13ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Volume volume-1fdc947c-94e8-42a0-89b6-1d207035b060 (1fdc947c-94e8-42a0-89b6-1d207035b060): created successfully Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01fee0a1-f530-447f-9efe-4bb15b5e13ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (ce50b05e-0b26-479a-83fc-f6aba4606556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a194d4f1-3c33-44fe-a043-848136b99ce9 tempest-ProjectReaderTests-1859696638 None] Created volume successfully. Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-1fdc947c-94e8-42a0-89b6-1d207035b060-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-1fdc947c-94e8-42a0-89b6-1d207035b060-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-quobyte-1fdc947c-94e8-42a0-89b6-1d207035b060" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-1fdc947c-94e8-42a0-89b6-1d207035b060" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd735283-f252-47e6-b4b5-abd7f4ff49b6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:34 devstack sudo[113328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 Aug 26 03:16:34 devstack sudo[113328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:34 devstack sudo[113328]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060" returned: 0 in 0.409s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:34 devstack sudo[113333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060 Aug 26 03:16:34 devstack sudo[113333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:34 devstack sudo[113333]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1fdc947c-94e8-42a0-89b6-1d207035b060" returned: 0 in 0.284s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-1fdc947c-94e8-42a0-89b6-1d207035b060" released by "delete_volume" :: held 0.753s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Created reservations ['18e1100e-d4ec-463b-aca6-31fb82741978', 'ae41a45e-7908-46bb-b784-1df5114af5e1', 'a822b101-ebdb-463c-b8d9-605b902ed967', '006c4c48-68ee-4b58-abff-d0b1a8b828db'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:34 devstack sudo[113336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:34 devstack sudo[113336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:35 devstack sudo[113336]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.332s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Deleted volume successfully. Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-092c9e23-0a16-47e2-8c04-43b8037021d0 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-1fdc947c-94e8-42a0-89b6-1d207035b060-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (d4088d79-f56f-4d76-a23b-ea7592ca8f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a03a6a-78b3-453a-bfd1-da1fb6e1d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9a03a6a-78b3-453a-bfd1-da1fb6e1d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57244925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8b533a-3505-4780-9a4d-525ebf0bcadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:36Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1761bf1d-fbe6-4cb1-9ac6-4534e077d9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1761bf1d-fbe6-4cb1-9ac6-4534e077d9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f35001e-7ac5-4e63-bf18-3be8e3ac90af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f35001e-7ac5-4e63-bf18-3be8e3ac90af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae8b533a-3505-4780-9a4d-525ebf0bcadb', 'volume_name': 'volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec5c985-9da8-4da5-8383-a3d94e87f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ec5c985-9da8-4da5-8383-a3d94e87f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b045a22c-a4d6-4bb2-a20b-9bf620162824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Volume ae8b533a-3505-4780-9a4d-525ebf0bcadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb', 'volume_size': 1} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:16:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57244925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae8b533a-3505-4780-9a4d-525ebf0bcadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c742ad5c6c84be1a289635ca3cbd1d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:16:36Z,use_quota=True,user_id='a61ee3d937ad4a0e9bd8347417c4926b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Creating volume ae8b533a-3505-4780-9a4d-525ebf0bcadb {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:16:35 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:16:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:35 devstack sudo[113339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb 1073741824 Aug 26 03:16:35 devstack sudo[113339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:36 devstack sudo[113339]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb 1073741824" returned: 0 in 0.483s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:36 devstack sudo[113345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb Aug 26 03:16:36 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:36 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb" returned: 0 in 0.300s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b045a22c-a4d6-4bb2-a20b-9bf620162824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e9f7d2-e79b-455a-a128-bfadf091dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:16:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Volume volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb (ae8b533a-3505-4780-9a4d-525ebf0bcadb): created successfully Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e9f7d2-e79b-455a-a128-bfadf091dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:16:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Flow 'volume_create_manager' (d4088d79-f56f-4d76-a23b-ea7592ca8f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:16:36 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f05e2bc2-064f-4d6d-b113-f42338127524 tempest-ProjectReaderTests-1859696638 None] Created volume successfully. Aug 26 03:16:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-ae8b533a-3505-4780-9a4d-525ebf0bcadb-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-ae8b533a-3505-4780-9a4d-525ebf0bcadb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "cinder-quobyte-ae8b533a-3505-4780-9a4d-525ebf0bcadb" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:16:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-ae8b533a-3505-4780-9a4d-525ebf0bcadb" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:16:37 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d3387-7eff-4f9c-aede-11fdcd396c57]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:16:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:37 devstack sudo[113351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb Aug 26 03:16:37 devstack sudo[113351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:38 devstack sudo[113351]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb" returned: 0 in 0.353s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:38 devstack sudo[113356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb Aug 26 03:16:38 devstack sudo[113356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:38 devstack sudo[113356]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ae8b533a-3505-4780-9a4d-525ebf0bcadb" returned: 0 in 0.228s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-quobyte-ae8b533a-3505-4780-9a4d-525ebf0bcadb" released by "delete_volume" :: held 0.616s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Created reservations ['bcafd3ea-bcb3-4819-969b-c4f617865bd8', 'c560fd26-30ec-4280-a102-2af0c55b46ba', '1807b55c-1f5b-4a21-9a2e-d7e37892caa1', '478a7a7c-ebe7-4832-8c1f-3d91b50e76d8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:16:38 devstack sudo[113359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:16:38 devstack sudo[113359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:16:38 devstack sudo[113359]: pam_unix(sudo:session): session closed for user root Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.234s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:16:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Deleted volume successfully. Aug 26 03:16:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-97b496bd-e35f-4901-b33f-0f17fad31b53 tempest-ProjectReaderTests-1859696638 None] Lock "cinder-ae8b533a-3505-4780-9a4d-525ebf0bcadb-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:16:48 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=60,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=16 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:16:48 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=83,cinder:SELECT=54,cinder:INSERT=16,cinder:DELETE=7 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:17:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-ee3fc317-b9b8-405d-9f1a-ae2eda23c8a6 req-c4e88ef5-4728-477e-8bef-8fd57ae897fd tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-ee3fc317-b9b8-405d-9f1a-ae2eda23c8a6 req-c4e88ef5-4728-477e-8bef-8fd57ae897fd tempest-TestStampPattern-471549970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [req-ee3fc317-b9b8-405d-9f1a-ae2eda23c8a6 req-c4e88ef5-4728-477e-8bef-8fd57ae897fd tempest-TestStampPattern-471549970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:00 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-ee3fc317-b9b8-405d-9f1a-ae2eda23c8a6 req-c4e88ef5-4728-477e-8bef-8fd57ae897fd tempest-TestStampPattern-471549970 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de', 'name': 'volume-0968ade0-92b9-40c5-8277-b8585cf28b2a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6910e21b-e777-4100-a57e-9ea82a019b35', 'enforce_multipath': True} {{(pid=94506) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 26 03:17:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-ee3fc317-b9b8-405d-9f1a-ae2eda23c8a6 req-c4e88ef5-4728-477e-8bef-8fd57ae897fd tempest-TestStampPattern-471549970 None] attachment_update completed successfully. Aug 26 03:17:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [req-9cb7a0eb-2663-452a-bf9b-3379f27b5f15 req-c91fa321-efb0-4b40-9dbf-748dde3a8d90 tempest-TestStampPattern-471549970 None] Terminate volume connection completed successfully. Aug 26 03:17:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [req-9cb7a0eb-2663-452a-bf9b-3379f27b5f15 req-c91fa321-efb0-4b40-9dbf-748dde3a8d90 tempest-TestStampPattern-471549970 None] Deleting attachment 6910e21b-e777-4100-a57e-9ea82a019b35. {{(pid=94506) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 26 03:17:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-0968ade0-92b9-40c5-8277-b8585cf28b2a-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Lock "cinder-0968ade0-92b9-40c5-8277-b8585cf28b2a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-quobyte-0968ade0-92b9-40c5-8277-b8585cf28b2a" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:07 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-0968ade0-92b9-40c5-8277-b8585cf28b2a" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aeda22-ce88-4a1b-93bc-0ee8b848ae24]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:08 devstack sudo[113856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a Aug 26 03:17:08 devstack sudo[113856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:08 devstack sudo[113856]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:08 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a Aug 26 03:17:08 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:08 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0968ade0-92b9-40c5-8277-b8585cf28b2a" returned: 0 in 0.239s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-0968ade0-92b9-40c5-8277-b8585cf28b2a" released by "delete_volume" :: held 0.611s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Created reservations ['58f1a65e-1f44-4bbb-840d-02a8b744d164', '19fdf2b4-4205-40bd-845d-b6a68ed2eb73', '9cc049e4-1d5f-419f-8479-b470b4fcbded', '6211c50d-d1d3-4a5a-9cbe-8a2c4be0a2b9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:08 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:17:08 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:08 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.226s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Deleted volume successfully. Aug 26 03:17:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-affc9d44-1ad9-43fc-8213-2027e6f8fbd3 tempest-TestStampPattern-471549970 None] Lock "cinder-0968ade0-92b9-40c5-8277-b8585cf28b2a-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-3af0db91-6154-405d-8931-6664674dce3d-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Lock "cinder-3af0db91-6154-405d-8931-6664674dce3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-quobyte-4a6d9854-593a-4dc4-af49-6895ca2d0305" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-4a6d9854-593a-4dc4-af49-6895ca2d0305" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-quobyte-3af0db91-6154-405d-8931-6664674dce3d" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-3af0db91-6154-405d-8931-6664674dce3d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Deleting offline snapshot 3af0db91-6154-405d-8931-6664674dce3d of volume 4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] snapshot_file for this snap is: volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48a8166-a014-48d4-9073-edc0b3c41487]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:09 devstack sudo[113867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d Aug 26 03:17:09 devstack sudo[113867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:09 devstack sudo[113867]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d" returned: 0 in 0.342s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4a6d9854-593a-4dc4-af49-6895ca2d0305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6db4ca-8d6a-4224-9f49-a225bea2b074]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:09 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 Aug 26 03:17:09 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:10 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305" returned: 0 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:10 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d Aug 26 03:17:10 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:10 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d" returned: 0 in 0.306s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:10 devstack sudo[113882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d Aug 26 03:17:10 devstack sudo[113882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:10 devstack sudo[113882]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305.3af0db91-6154-405d-8931-6664674dce3d" returned: 0 in 0.237s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-3af0db91-6154-405d-8931-6664674dce3d" released by "_delete_snapshot" :: held 1.492s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-4a6d9854-593a-4dc4-af49-6895ca2d0305" released by "delete_snapshot" :: held 1.516s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Created reservations ['e0cff6b3-8f7b-4fec-b660-993e45b34d84', 'e3858cf2-d00e-470e-84bc-8901c4766680', 'a3ec8917-41b6-4457-947f-7f231d383986', 'ac57e5d7-9404-451d-ba4e-3a80aa0e9cc6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Delete snapshot completed successfully. Aug 26 03:17:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-50eb3086-2c93-428e-a3c1-d7d1c3ed9674 tempest-TestStampPattern-471549970 None] Lock "cinder-3af0db91-6154-405d-8931-6664674dce3d-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-4a6d9854-593a-4dc4-af49-6895ca2d0305-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Lock "cinder-4a6d9854-593a-4dc4-af49-6895ca2d0305-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Acquiring lock "cinder-quobyte-4a6d9854-593a-4dc4-af49-6895ca2d0305" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-4a6d9854-593a-4dc4-af49-6895ca2d0305" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd0c4d0-e06a-4d25-b350-ea8ff726502b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:15 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 Aug 26 03:17:15 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:15 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:15 devstack sudo[113922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305 Aug 26 03:17:15 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:15 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4a6d9854-593a-4dc4-af49-6895ca2d0305" returned: 0 in 0.246s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Lock "cinder-quobyte-4a6d9854-593a-4dc4-af49-6895ca2d0305" released by "delete_volume" :: held 0.648s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Created reservations ['f87184ef-0b18-4999-bc0e-e2941b8942b4', '351bdb21-4eb6-4a12-98d5-43eb1a14dfc0', '570f0662-ea6f-4859-ab3a-1147c9b5ba54', '22b166d5-fda1-4e68-976b-1edb58e57c98'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:15 devstack sudo[113925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:17:15 devstack sudo[113925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:16 devstack sudo[113925]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.253s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:16 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Deleted volume successfully. Aug 26 03:17:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13555d54-36e2-480d-83fc-15f129292ea4 tempest-TestStampPattern-471549970 None] Lock "cinder-4a6d9854-593a-4dc4-af49-6895ca2d0305-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:20 devstack sudo[113939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:17:20 devstack sudo[113939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:20 devstack sudo[113939]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.284s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:17:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:17:25 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=7 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:17:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Flow 'volume_create_manager' (18b068c7-96c8-426e-8c42-93572c3b4b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c322e4b1-3cb5-41ac-8dee-66a7d8babf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c322e4b1-3cb5-41ac-8dee-66a7d8babf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495ef111-d79d-45b8-ae9a-17514fb89f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9613fa9df6a0409e8a529d7a1e1f1599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:31Z,use_quota=True,user_id='ece239082be443e4ad7e141631f43b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4261c19-0255-465a-80cb-cea6489e08a5),volume_type_id=b4261c19-0255-465a-80cb-cea6489e08a5)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cc8d04-139c-483b-a1ff-86cca7bd8614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18cc8d04-139c-483b-a1ff-86cca7bd8614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d9b648-42da-49c1-b6a7-337d6e74c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:30 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d9b648-42da-49c1-b6a7-337d6e74c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '495ef111-d79d-45b8-ae9a-17514fb89f22', 'volume_name': 'volume-495ef111-d79d-45b8-ae9a-17514fb89f22', 'volume_size': 1, 'image_id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca69d018121a4d3cc0f8631b55f0cc2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9613fa9df6a0409e8a529d7a1e1f1599', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f0ae61d3aabfb14eb69817b75166df725737b8aac0100fbc285601eb91164f39ef47e2f43e81a960f1aa2fbdd49eda4d5372bda73cd279566835f183b138d1af', 'id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77939c31-92c9-4162-a76d-561fc9220aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77939c31-92c9-4162-a76d-561fc9220aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eea95d8-065d-4416-86eb-bfb3b9f8f85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:31 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Volume 495ef111-d79d-45b8-ae9a-17514fb89f22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-495ef111-d79d-45b8-ae9a-17514fb89f22', 'volume_size': 1, 'image_id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca69d018121a4d3cc0f8631b55f0cc2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9613fa9df6a0409e8a529d7a1e1f1599', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f0ae61d3aabfb14eb69817b75166df725737b8aac0100fbc285601eb91164f39ef47e2f43e81a960f1aa2fbdd49eda4d5372bda73cd279566835f183b138d1af', 'id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Trying to clone 495ef111-d79d-45b8-ae9a-17514fb89f22 from image 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:17:31 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc81b91-c685-4bca-a76e-f6474252ca34]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:31 devstack sudo[113982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD Aug 26 03:17:31 devstack sudo[113982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:31 devstack sudo[113982]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:31 devstack sudo[113986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD Aug 26 03:17:31 devstack sudo[113986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:31 devstack sudo[113986]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD" returned: 1 in 0.323s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Temporary image 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 is fetched for user ece239082be443e4ad7e141631f43b87. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c539fb1f-bf9f-4da7-a92a-a0409580039e]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:32 devstack sudo[113991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD Aug 26 03:17:32 devstack sudo[113991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:32 devstack sudo[113991]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:32 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD Aug 26 03:17:32 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:32 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495ef111-d79d-45b8-ae9a-17514fb89f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9613fa9df6a0409e8a529d7a1e1f1599',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:31Z,use_quota=True,user_id='ece239082be443e4ad7e141631f43b87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b4261c19-0255-465a-80cb-cea6489e08a5),volume_type_id=b4261c19-0255-465a-80cb-cea6489e08a5)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Creating volume 495ef111-d79d-45b8-ae9a-17514fb89f22 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:32 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:32 devstack sudo[114000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 1073741824 Aug 26 03:17:32 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:32 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 1073741824" returned: 0 in 0.411s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:33 devstack sudo[114007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 Aug 26 03:17:33 devstack sudo[114007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:33 devstack sudo[114007]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22" returned: 0 in 0.240s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Attempting download of 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'metadata': {}}])) to volume 495ef111-d79d-45b8-ae9a-17514fb89f22. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[769f92f4-d951-4d5a-8668-6d526535c8c3]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:33 devstack sudo[114010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih Aug 26 03:17:33 devstack sudo[114010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:33 devstack sudo[114010]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih" returned: 0 in 0.311s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:33 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih Aug 26 03:17:33 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:33 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih" returned: 1 in 0.331s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_kdzq7lih' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e7e0ae-5c73-4cf0-bda0-9ea50782d625]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:34 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD Aug 26 03:17:34 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:34 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:34 devstack sudo[114023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD Aug 26 03:17:34 devstack sudo[114023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:34 devstack sudo[114023]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD" returned: 1 in 0.331s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:34 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 was raw, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:17:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:34 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 Aug 26 03:17:34 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:35 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1ce7524a-d40e-448f-9e0f-4dceeda1ffc3_tg_lwabmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:17:35 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:35 devstack sudo[114034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 1G Aug 26 03:17:35 devstack sudo[114034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:35 devstack sudo[114034]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 1G" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Downloaded image 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 ((None, [{'url': 'file:///opt/stack/data/glance/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'metadata': {}}])) to volume 495ef111-d79d-45b8-ae9a-17514fb89f22 successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Temporary image 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 for user ece239082be443e4ad7e141631f43b87 is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Marking volume 495ef111-d79d-45b8-ae9a-17514fb89f22 as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Copying metadata from image 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 to 495ef111-d79d-45b8-ae9a-17514fb89f22. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Creating volume glance metadata for volume 495ef111-d79d-45b8-ae9a-17514fb89f22 backed by image 1ce7524a-d40e-448f-9e0f-4dceeda1ffc3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4ca69d018121a4d3cc0f8631b55f0cc2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eea95d8-065d-4416-86eb-bfb3b9f8f85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495ef111-d79d-45b8-ae9a-17514fb89f22', 'volume_size': 1, 'image_id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ca69d018121a4d3cc0f8631b55f0cc2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9613fa9df6a0409e8a529d7a1e1f1599', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f0ae61d3aabfb14eb69817b75166df725737b8aac0100fbc285601eb91164f39ef47e2f43e81a960f1aa2fbdd49eda4d5372bda73cd279566835f183b138d1af', 'id': '1ce7524a-d40e-448f-9e0f-4dceeda1ffc3', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1ce7524a-d40e-448f-9e0f-4dceeda1ffc3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e17fa4-e581-46b2-a7a0-2d767a5245bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Volume volume-495ef111-d79d-45b8-ae9a-17514fb89f22 (495ef111-d79d-45b8-ae9a-17514fb89f22): created successfully Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e17fa4-e581-46b2-a7a0-2d767a5245bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Flow 'volume_create_manager' (18b068c7-96c8-426e-8c42-93572c3b4b71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9a2e57e4-aaed-416a-84c3-10864560679b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Created volume successfully. Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Acquiring lock "cinder-495ef111-d79d-45b8-ae9a-17514fb89f22-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "cinder-495ef111-d79d-45b8-ae9a-17514fb89f22-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Acquiring lock "cinder-quobyte-495ef111-d79d-45b8-ae9a-17514fb89f22" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "cinder-quobyte-495ef111-d79d-45b8-ae9a-17514fb89f22" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dead203-57d9-46b6-83b9-4ef1a20fe2e2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:36 devstack sudo[114039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 Aug 26 03:17:36 devstack sudo[114039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:36 devstack sudo[114039]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22" returned: 0 in 0.354s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:36 devstack sudo[114044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22 Aug 26 03:17:36 devstack sudo[114044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:36 devstack sudo[114044]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-495ef111-d79d-45b8-ae9a-17514fb89f22" returned: 0 in 0.236s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "cinder-quobyte-495ef111-d79d-45b8-ae9a-17514fb89f22" released by "delete_volume" :: held 0.624s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:36 devstack cinder-volume[94506]: WARNING cinder.quota [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:17:36 devstack cinder-volume[94506]: WARNING cinder.quota [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Created reservations ['956d6097-6df6-4778-90ce-7610657a4a21', '9741b5bd-bdfa-4161-88b9-e8afc824993e', '4cf4cc76-dce4-4448-8f9e-e8f107149669', '9f92c4ca-5383-4807-a0d1-2932921935ec'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:36 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:17:36 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:37 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.235s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:37 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Deleted volume successfully. Aug 26 03:17:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-13d4cd8d-855d-435c-a96e-dc948421797b tempest-VolumeAndVolumeTypeFromImageTest-1302007949 None] Lock "cinder-495ef111-d79d-45b8-ae9a-17514fb89f22-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Flow 'volume_create_manager' (3b547a2b-f218-4360-8f58-a5c6775f2114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82b5a63-7c54-470a-8603-6d24e97af454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d82b5a63-7c54-470a-8603-6d24e97af454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a847efcb-c0e6-472e-b49a-4440e4d1e613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9bc5a42f15848299703336d2014bfcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='eeb99e7d4e41498ab46415def407925e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21034a66-4cd3-4c28-babe-390d278d50af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21034a66-4cd3-4c28-babe-390d278d50af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c59fad2-0309-42fa-9007-b0bb308c404d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c59fad2-0309-42fa-9007-b0bb308c404d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a847efcb-c0e6-472e-b49a-4440e4d1e613', 'volume_name': 'volume-a847efcb-c0e6-472e-b49a-4440e4d1e613', 'volume_size': 1, 'image_id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72bac63a97ef156ef1aaef466cb4702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9bc5a42f15848299703336d2014bfcd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a79f91b8761656657741f0eff85827ec071003fb401e04012d1f1113691e40cae9fe330c3b1c1d2c7b3ada0b913b10635a839f0d558faac60492e5f3901a2979', 'id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c/file', 'properties': {}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b21cee0-80f6-4039-a904-9427f949cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b21cee0-80f6-4039-a904-9427f949cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8696eb77-3284-43be-8ab4-440e45182671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:43 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Volume a847efcb-c0e6-472e-b49a-4440e4d1e613: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a847efcb-c0e6-472e-b49a-4440e4d1e613', 'volume_size': 1, 'image_id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72bac63a97ef156ef1aaef466cb4702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9bc5a42f15848299703336d2014bfcd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a79f91b8761656657741f0eff85827ec071003fb401e04012d1f1113691e40cae9fe330c3b1c1d2c7b3ada0b913b10635a839f0d558faac60492e5f3901a2979', 'id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c/file', 'properties': {}}, 'image_service': } Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Trying to clone a847efcb-c0e6-472e-b49a-4440e4d1e613 from image b23d8bc1-0dad-4d2b-9add-8fe2dddc463c at location (None, [{'url': 'file:///opt/stack/data/glance/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:17:43 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948730c-d30a-4885-89dd-aeff23699516]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:44 devstack sudo[114053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD Aug 26 03:17:44 devstack sudo[114053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:44 devstack sudo[114053]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:44 devstack sudo[114057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD Aug 26 03:17:44 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:44 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD" returned: 1 in 0.349s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Temporary image b23d8bc1-0dad-4d2b-9add-8fe2dddc463c is fetched for user eeb99e7d4e41498ab46415def407925e. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd4e443-c55c-45d3-af0e-8cd1216dcb86]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:44 devstack sudo[114062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD Aug 26 03:17:44 devstack sudo[114062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:45 devstack sudo[114062]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:45 devstack sudo[114066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD Aug 26 03:17:45 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:45 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD" returned: 1 in 0.358s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a847efcb-c0e6-472e-b49a-4440e4d1e613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9bc5a42f15848299703336d2014bfcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:43Z,use_quota=True,user_id='eeb99e7d4e41498ab46415def407925e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Creating volume a847efcb-c0e6-472e-b49a-4440e4d1e613 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:45 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:45 devstack sudo[114071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 1073741824 Aug 26 03:17:45 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:45 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 1073741824" returned: 0 in 0.450s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:45 devstack sudo[114076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 Aug 26 03:17:45 devstack sudo[114076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:46 devstack sudo[114076]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613" returned: 0 in 0.272s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Attempting download of b23d8bc1-0dad-4d2b-9add-8fe2dddc463c ((None, [{'url': 'file:///opt/stack/data/glance/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'metadata': {}}])) to volume a847efcb-c0e6-472e-b49a-4440e4d1e613. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[25274eee-eac0-4ce0-8cb1-2c3409aebb79]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:46 devstack sudo[114079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e Aug 26 03:17:46 devstack sudo[114079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:46 devstack sudo[114079]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e" returned: 0 in 0.314s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:46 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e Aug 26 03:17:46 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:46 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e" returned: 1 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_9qgdsw9e' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7667ee1-f74b-4bde-9cd5-030d193a4233]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:47 devstack sudo[114087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD Aug 26 03:17:47 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:47 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:47 devstack sudo[114091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD Aug 26 03:17:47 devstack sudo[114091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:47 devstack sudo[114091]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD" returned: 1 in 0.321s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:17:47 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] b23d8bc1-0dad-4d2b-9add-8fe2dddc463c was raw, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:17:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:47 devstack sudo[114096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 Aug 26 03:17:47 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613" returned: 0 in 0.436s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b23d8bc1-0dad-4d2b-9add-8fe2dddc463c_ekt9r_33devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:17:48 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:48 devstack sudo[114102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 1G Aug 26 03:17:48 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:48 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 1G" returned: 0 in 0.300s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Downloaded image b23d8bc1-0dad-4d2b-9add-8fe2dddc463c ((None, [{'url': 'file:///opt/stack/data/glance/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'metadata': {}}])) to volume a847efcb-c0e6-472e-b49a-4440e4d1e613 successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Temporary image b23d8bc1-0dad-4d2b-9add-8fe2dddc463c for user eeb99e7d4e41498ab46415def407925e is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Marking volume a847efcb-c0e6-472e-b49a-4440e4d1e613 as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Copying metadata from image b23d8bc1-0dad-4d2b-9add-8fe2dddc463c to a847efcb-c0e6-472e-b49a-4440e4d1e613. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Creating volume glance metadata for volume a847efcb-c0e6-472e-b49a-4440e4d1e613 backed by image b23d8bc1-0dad-4d2b-9add-8fe2dddc463c with: {'image_id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '72bac63a97ef156ef1aaef466cb4702f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8696eb77-3284-43be-8ab4-440e45182671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a847efcb-c0e6-472e-b49a-4440e4d1e613', 'volume_size': 1, 'image_id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '72bac63a97ef156ef1aaef466cb4702f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd9bc5a42f15848299703336d2014bfcd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a79f91b8761656657741f0eff85827ec071003fb401e04012d1f1113691e40cae9fe330c3b1c1d2c7b3ada0b913b10635a839f0d558faac60492e5f3901a2979', 'id': 'b23d8bc1-0dad-4d2b-9add-8fe2dddc463c', 'created_at': datetime.datetime(2026, 8, 26, 1, 17, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 17, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b23d8bc1-0dad-4d2b-9add-8fe2dddc463c/file', 'properties': {}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07593c1-9c4e-4a33-8aa6-48726ee6e8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:48 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Volume volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 (a847efcb-c0e6-472e-b49a-4440e4d1e613): created successfully Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07593c1-9c4e-4a33-8aa6-48726ee6e8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Flow 'volume_create_manager' (3b547a2b-f218-4360-8f58-a5c6775f2114) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a1d14b11-94b9-4948-9912-f8918ba3f322 tempest-VolumeImageDependencyTests-2134542704 None] Created volume successfully. Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Acquiring lock "cinder-a847efcb-c0e6-472e-b49a-4440e4d1e613-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Lock "cinder-a847efcb-c0e6-472e-b49a-4440e4d1e613-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Acquiring lock "cinder-quobyte-a847efcb-c0e6-472e-b49a-4440e4d1e613" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Lock "cinder-quobyte-a847efcb-c0e6-472e-b49a-4440e4d1e613" acquired by "delete_volume" :: waited 0.013s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[19304573-58c3-4dd2-9ee0-5937f5c1de05]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 Aug 26 03:17:49 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613" returned: 0 in 0.344s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613 Aug 26 03:17:49 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a847efcb-c0e6-472e-b49a-4440e4d1e613" returned: 0 in 0.246s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Lock "cinder-quobyte-a847efcb-c0e6-472e-b49a-4440e4d1e613" released by "delete_volume" :: held 0.626s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Created reservations ['00f923ab-9da8-4fc5-8cf9-c1e9c4970912', '80e4806c-6414-4814-9494-2897a8b02033', 'dc758f37-dbe8-4040-8bd0-d16ab22f270c', '972f0232-6cad-44f1-9911-80fe6f9d1cf3'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:49 devstack sudo[114115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:17:49 devstack sudo[114115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:49 devstack sudo[114115]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.244s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:17:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Deleted volume successfully. Aug 26 03:17:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c2db04b-0090-4f37-8c25-620ce790766c tempest-VolumeImageDependencyTests-2134542704 None] Lock "cinder-a847efcb-c0e6-472e-b49a-4440e4d1e613-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:17:52 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Flow 'volume_create_manager' (ce3ed3e0-7a1f-452f-ade3-5bb55f658727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae8dde-7d85-446f-be29-9a95da2fc93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:52 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ae8dde-7d85-446f-be29-9a95da2fc93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166b476-a772-43da-abef-cf54c04009e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfe11468962430697533cb3902b087d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:53Z,use_quota=True,user_id='d7d3471c684e4bb191ce26c91893071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f960b1-38f8-46e6-baad-8815091af7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f960b1-38f8-46e6-baad-8815091af7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3128b555-f475-47a8-8766-aac250ee7871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3128b555-f475-47a8-8766-aac250ee7871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f166b476-a772-43da-abef-cf54c04009e2', 'volume_name': 'volume-f166b476-a772-43da-abef-cf54c04009e2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc7d3c8-e4c1-41af-b150-a1b00c7679e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc7d3c8-e4c1-41af-b150-a1b00c7679e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30adb9f1-c72f-4d5a-acf1-321cf7a3e1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Volume f166b476-a772-43da-abef-cf54c04009e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f166b476-a772-43da-abef-cf54c04009e2', 'volume_size': 1} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f166b476-a772-43da-abef-cf54c04009e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfe11468962430697533cb3902b087d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:53Z,use_quota=True,user_id='d7d3471c684e4bb191ce26c91893071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Creating volume f166b476-a772-43da-abef-cf54c04009e2 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:53 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:53 devstack sudo[114119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 1073741824 Aug 26 03:17:53 devstack sudo[114119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack sudo[114119]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 1073741824" returned: 0 in 0.441s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:53 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 Aug 26 03:17:53 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:53 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2" returned: 0 in 0.246s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30adb9f1-c72f-4d5a-acf1-321cf7a3e1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f166b476-a772-43da-abef-cf54c04009e2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5ab03d-41d8-4552-bc49-e15ccf9a4026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Volume volume-f166b476-a772-43da-abef-cf54c04009e2 (f166b476-a772-43da-abef-cf54c04009e2): created successfully Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5ab03d-41d8-4552-bc49-e15ccf9a4026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Flow 'volume_create_manager' (ce3ed3e0-7a1f-452f-ade3-5bb55f658727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0bc2dcc3-cc8e-453d-a2b1-9880e0fa90bc tempest-CinderUnicodeTest-2056327689 None] Created volume successfully. Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Flow 'volume_create_manager' (d4878be5-3ca7-441d-bd38-b4b0fb9be81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d2610a-115a-44bc-a7d1-d012d2f5f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d2610a-115a-44bc-a7d1-d012d2f5f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-657395483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba3880e-ff19-464d-aa66-df383f363447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfe11468962430697533cb3902b087d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:56Z,use_quota=True,user_id='d7d3471c684e4bb191ce26c91893071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164e12dd-21db-4250-9053-3de23b2a51d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164e12dd-21db-4250-9053-3de23b2a51d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c905a88b-0815-4bea-8420-ec00caa4a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c905a88b-0815-4bea-8420-ec00caa4a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba3880e-ff19-464d-aa66-df383f363447', 'volume_name': 'volume-5ba3880e-ff19-464d-aa66-df383f363447', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152b8f9e-23ae-4b90-86be-eca52bb74827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (152b8f9e-23ae-4b90-86be-eca52bb74827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c11ad9-4e8a-43fa-8a57-238cebb79f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Volume 5ba3880e-ff19-464d-aa66-df383f363447: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba3880e-ff19-464d-aa66-df383f363447', 'volume_size': 1} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:17:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-657395483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba3880e-ff19-464d-aa66-df383f363447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adfe11468962430697533cb3902b087d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:17:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:17:56Z,use_quota=True,user_id='d7d3471c684e4bb191ce26c91893071f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Creating volume 5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:17:55 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:17:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:55 devstack sudo[114128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 1073741824 Aug 26 03:17:55 devstack sudo[114128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack sudo[114128]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 1073741824" returned: 0 in 0.432s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack sudo[114134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 Aug 26 03:17:56 devstack sudo[114134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:56 devstack sudo[114134]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447" returned: 0 in 0.265s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51c11ad9-4e8a-43fa-8a57-238cebb79f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba3880e-ff19-464d-aa66-df383f363447', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feafcc02-eba2-43b9-9018-42905e0a64c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:17:56 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Volume volume-5ba3880e-ff19-464d-aa66-df383f363447 (5ba3880e-ff19-464d-aa66-df383f363447): created successfully Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feafcc02-eba2-43b9-9018-42905e0a64c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Flow 'volume_create_manager' (d4878be5-3ca7-441d-bd38-b4b0fb9be81d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:17:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-99ae3623-1f51-40b2-8ad6-02c9369ce2d0 tempest-CinderUnicodeTest-2056327689 None] Created volume successfully. Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Creating offline snapshot dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 of volume 5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a2e09d-a417-4b11-8613-64c84888522a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:56 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 Aug 26 03:17:56 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447" returned: 0 in 0.382s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[114142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 1G Aug 26 03:17:57 devstack sudo[114142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack sudo[114142]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 1G" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba3880e-ff19-464d-aa66-df383f363447 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba3880e-ff19-464d-aa66-df383f363447 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 Aug 26 03:17:57 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:57 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba3880e-ff19-464d-aa66-df383f363447 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:57 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 is being set with open permissions: ugo+rw Aug 26 03:17:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:57 devstack sudo[114153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 Aug 26 03:17:57 devstack sudo[114153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack sudo[114153]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack sudo[114156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info Aug 26 03:17:58 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info" returned: 0 in 0.246s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info is being set with open permissions: ugo+rw Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:58 devstack sudo[114159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info Aug 26 03:17:58 devstack sudo[114159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:58 devstack sudo[114159]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.info" returned: 0 in 0.238s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:17:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7d945abd-ba3f-4c89-855a-e77f7ef188df tempest-CinderUnicodeTest-2056327689 None] Create snapshot completed successfully Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-dbfe49c2-46bc-44d2-9b3e-3c1104e5d695-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-dbfe49c2-46bc-44d2-9b3e-3c1104e5d695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-quobyte-5ba3880e-ff19-464d-aa66-df383f363447" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-5ba3880e-ff19-464d-aa66-df383f363447" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-quobyte-dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Deleting offline snapshot dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 of volume 5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] snapshot_file for this snap is: volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b13b14-e79b-4fcf-9d83-7398ed131466]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack sudo[114162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 Aug 26 03:17:59 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ba3880e-ff19-464d-aa66-df383f363447(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef494de2-3d44-43ab-a54f-d1768ef99f33]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack sudo[114167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 Aug 26 03:17:59 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:17:59 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447" returned: 0 in 0.335s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:17:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:17:59 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 Aug 26 03:17:59 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:00 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" returned: 0 in 0.338s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:00 devstack sudo[114178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695 Aug 26 03:18:00 devstack sudo[114178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:00 devstack sudo[114178]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447.dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" returned: 0 in 0.244s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-dbfe49c2-46bc-44d2-9b3e-3c1104e5d695" released by "_delete_snapshot" :: held 1.364s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-5ba3880e-ff19-464d-aa66-df383f363447" released by "delete_snapshot" :: held 1.384s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Created reservations ['5e6a266e-68d7-4aa6-8270-5c164c43fe78', 'a1ba913b-1980-46c4-9a3f-707bbbf0ae9e', 'd0a76c88-2cfe-4e30-98c9-c1afabab7f50', 'e13b4b17-071f-4219-a3ea-c91cdac0e24f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Delete snapshot completed successfully. Aug 26 03:18:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-bb09bab5-e415-488b-a7ba-bca96bfae8ba tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-dbfe49c2-46bc-44d2-9b3e-3c1104e5d695-delete_snapshot" released by "delete_snapshot" :: held 1.507s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-5ba3880e-ff19-464d-aa66-df383f363447-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-5ba3880e-ff19-464d-aa66-df383f363447-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-quobyte-5ba3880e-ff19-464d-aa66-df383f363447" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-5ba3880e-ff19-464d-aa66-df383f363447" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf55bd-9905-4e71-803a-e44708663238]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:01 devstack sudo[114181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 Aug 26 03:18:01 devstack sudo[114181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:01 devstack sudo[114181]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447" returned: 0 in 0.337s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:01 devstack sudo[114186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447 Aug 26 03:18:01 devstack sudo[114186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:01 devstack sudo[114186]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5ba3880e-ff19-464d-aa66-df383f363447" returned: 0 in 0.224s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-5ba3880e-ff19-464d-aa66-df383f363447" released by "delete_volume" :: held 0.619s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Created reservations ['79ab42cb-6870-4d70-aa24-655335fc0c53', 'cae3377a-16ee-4102-8d3b-1efdf1de8ac6', '7804897c-e861-4aca-a084-0d237fec00e7', '9c4b21a8-b5f7-46b8-9409-1b6125f6536a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:01 devstack sudo[114189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:01 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:02 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.246s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Deleted volume successfully. Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c6d861a8-67c0-4d63-a805-538bb613b09d tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-5ba3880e-ff19-464d-aa66-df383f363447-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-f166b476-a772-43da-abef-cf54c04009e2-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-f166b476-a772-43da-abef-cf54c04009e2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "cinder-quobyte-f166b476-a772-43da-abef-cf54c04009e2" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-f166b476-a772-43da-abef-cf54c04009e2" acquired by "delete_volume" :: waited 0.013s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13fa4ff-1d9d-4bcd-a2c5-11f88d2996d9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:02 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 Aug 26 03:18:02 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:02 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:02 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2 Aug 26 03:18:02 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:02 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f166b476-a772-43da-abef-cf54c04009e2" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-quobyte-f166b476-a772-43da-abef-cf54c04009e2" released by "delete_volume" :: held 0.651s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Created reservations ['166315ed-05de-4328-bff9-1e27523fd69b', '8542acdd-d7bc-496d-b239-b00b618f1a30', 'fe7e92f2-7cac-4e3c-b105-aec2eaf387be', '04815f9a-6cd4-47c3-ba14-5da753df7d13'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:03 devstack sudo[114200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:03 devstack sudo[114200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:03 devstack sudo[114200]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.263s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:03 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Deleted volume successfully. Aug 26 03:18:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-ac0eb2c8-50ee-4225-8fc6-648e4fcc824c tempest-CinderUnicodeTest-2056327689 None] Lock "cinder-f166b476-a772-43da-abef-cf54c04009e2-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (41553878-e36a-46a6-9cf3-4f4d1ce4b60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a1fd61-2210-4637-b9fb-ccbbdc2260d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a1fd61-2210-4637-b9fb-ccbbdc2260d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002185699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095ccb79-4e0a-452b-b916-4f6aae24fbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:15Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23223db-0031-4c61-87b1-3edbed5ea1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23223db-0031-4c61-87b1-3edbed5ea1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afda1140-c2a0-4077-a32c-e02b9adf0372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afda1140-c2a0-4077-a32c-e02b9adf0372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '095ccb79-4e0a-452b-b916-4f6aae24fbf8', 'volume_name': 'volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef46cea-3bcb-41e0-a594-b2a1529ffef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef46cea-3bcb-41e0-a594-b2a1529ffef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571a6f6c-ee19-440f-86f5-32a41ba32ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:15 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Volume 095ccb79-4e0a-452b-b916-4f6aae24fbf8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8', 'volume_size': 1} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1002185699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=095ccb79-4e0a-452b-b916-4f6aae24fbf8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:15Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Creating volume 095ccb79-4e0a-452b-b916-4f6aae24fbf8 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:15 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:15 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 1073741824 Aug 26 03:18:15 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (0b2e02fb-d64d-4354-a3a6-8c9bad81d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b33a4e5-0a99-4860-b6b5-16657e0ea92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b33a4e5-0a99-4860-b6b5-16657e0ea92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667169540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb33ace-6cdb-4c33-bfc4-10e4c10c2b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:16Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70e8334-1bc0-4492-b444-ee674272476d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e70e8334-1bc0-4492-b444-ee674272476d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38d9695-ee3d-4d73-bc44-163370578fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e38d9695-ee3d-4d73-bc44-163370578fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acb33ace-6cdb-4c33-bfc4-10e4c10c2b38', 'volume_name': 'volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86611fa8-7bf3-4ced-9d6e-541c097590a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86611fa8-7bf3-4ced-9d6e-541c097590a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa754c0f-6d00-4f59-8f06-b4662f0f43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Volume acb33ace-6cdb-4c33-bfc4-10e4c10c2b38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38', 'volume_size': 1} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:16 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 1073741824" returned: 0 in 0.693s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:16 devstack sudo[114252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 Aug 26 03:18:16 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Flow 'volume_create_manager' (09ce38f9-2217-488c-af80-cd51773d5393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a180f220-42e2-47f7-8ac9-a89e1b3c9b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a180f220-42e2-47f7-8ac9-a89e1b3c9b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48cd885-7c69-4bcd-84c9-43fd7820803e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf618f5f974dfd8727f1b89651934b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:16Z,use_quota=True,user_id='9982d895118f44638105d2d72363e3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99815335-eb55-496d-a154-12d94a345a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99815335-eb55-496d-a154-12d94a345a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bf2989-9de9-496d-bfa4-f51958194563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51bf2989-9de9-496d-bfa4-f51958194563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd48cd885-7c69-4bcd-84c9-43fd7820803e', 'volume_name': 'volume-d48cd885-7c69-4bcd-84c9-43fd7820803e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd56e31b-e7b9-4748-b5de-f6e15ef04810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd56e31b-e7b9-4748-b5de-f6e15ef04810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4708ced-55dd-430a-b8cf-7e859295b2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Volume d48cd885-7c69-4bcd-84c9-43fd7820803e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d48cd885-7c69-4bcd-84c9-43fd7820803e', 'volume_size': 1} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (93fdbccd-3ba8-4b8c-9b46-09bc9e89a1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57786297-76cf-4e4c-b7fc-d4ec0caa5398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8" returned: 0 in 0.437s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57786297-76cf-4e4c-b7fc-d4ec0caa5398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481637032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6d572f-949a-4f85-88ab-4da0fc4f26a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:16Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75ca65-7349-4b11-8e60-663238d70771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f75ca65-7349-4b11-8e60-663238d70771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e340e921-2370-4568-8e6a-d6ba0e0b8de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e340e921-2370-4568-8e6a-d6ba0e0b8de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d6d572f-949a-4f85-88ab-4da0fc4f26a0', 'volume_name': 'volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5132cbdd-296f-47cc-8cb1-a6a3858933b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5132cbdd-296f-47cc-8cb1-a6a3858933b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917d424c-6aab-4ad2-bde0-4469ac367937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Volume 7d6d572f-949a-4f85-88ab-4da0fc4f26a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0', 'volume_size': 1} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667169540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acb33ace-6cdb-4c33-bfc4-10e4c10c2b38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:16Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Creating volume acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:16 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:16 devstack sudo[114255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 1073741824 Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571a6f6c-ee19-440f-86f5-32a41ba32ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack sudo[114255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfe3b9a-e903-4539-9f9c-7c93aa051e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Volume volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 (095ccb79-4e0a-452b-b916-4f6aae24fbf8): created successfully Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbfe3b9a-e903-4539-9f9c-7c93aa051e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (41553878-e36a-46a6-9cf3-4f4d1ce4b60c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ab836c5f-b6ee-408f-acb1-6dd2b79806d5 tempest-CreateVolumesFromImageTest-1142248136 None] Created volume successfully. Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (f8eb3bb7-d614-4f8e-bbba-d748568e59aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175d5a38-bb5a-4c4b-afee-517ca997a411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175d5a38-bb5a-4c4b-afee-517ca997a411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-951972274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a14f833-b693-4d9b-b67b-469a75ed46a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:17Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f41eff1-9b14-4020-818f-0a4d38daa8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f41eff1-9b14-4020-818f-0a4d38daa8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee171e0-d8fb-4ee1-ac89-8787bd784595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee171e0-d8fb-4ee1-ac89-8787bd784595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a14f833-b693-4d9b-b67b-469a75ed46a3', 'volume_name': 'volume-9a14f833-b693-4d9b-b67b-469a75ed46a3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a432a39-5262-40aa-9bba-54ecae17a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a432a39-5262-40aa-9bba-54ecae17a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abe6b3b-41a0-43ee-b7a7-e442fa5e8714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Volume 9a14f833-b693-4d9b-b67b-469a75ed46a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a14f833-b693-4d9b-b67b-469a75ed46a3', 'volume_size': 1} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:17 devstack sudo[114255]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 1073741824" returned: 0 in 0.753s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (2e76ebc4-c98d-47db-89a0-56c07f1f6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fe606a-a847-4ce2-8e95-154579eb6fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fe606a-a847-4ce2-8e95-154579eb6fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129819463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e019bd6-2af6-4a92-a573-a0bc15211116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:17Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3565c1-a759-4f06-b8ed-10851fd3407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3565c1-a759-4f06-b8ed-10851fd3407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ef8bd8-4e26-40fc-a319-f7c01cf1bf9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ef8bd8-4e26-40fc-a319-f7c01cf1bf9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e019bd6-2af6-4a92-a573-a0bc15211116', 'volume_name': 'volume-3e019bd6-2af6-4a92-a573-a0bc15211116', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ac0a04-707d-43c4-a2ec-06a82e5d08ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70ac0a04-707d-43c4-a2ec-06a82e5d08ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b53a47-f72e-4549-a557-0b6deb3e8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Volume 3e019bd6-2af6-4a92-a573-a0bc15211116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e019bd6-2af6-4a92-a573-a0bc15211116', 'volume_size': 1} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:17 devstack sudo[114264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 Aug 26 03:18:17 devstack sudo[114264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:17 devstack sudo[114264]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38" returned: 0 in 0.268s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] <== create_volume: return (1149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d48cd885-7c69-4bcd-84c9-43fd7820803e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf618f5f974dfd8727f1b89651934b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:16Z,use_quota=True,user_id='9982d895118f44638105d2d72363e3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Creating volume d48cd885-7c69-4bcd-84c9-43fd7820803e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:17 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:17 devstack sudo[114267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e 1073741824 Aug 26 03:18:17 devstack sudo[114267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa754c0f-6d00-4f59-8f06-b4662f0f43fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7d6dab-1e32-4f8e-8fed-a0b44ae95d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Volume volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 (acb33ace-6cdb-4c33-bfc4-10e4c10c2b38): created successfully Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae7d6dab-1e32-4f8e-8fed-a0b44ae95d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (0b2e02fb-d64d-4354-a3a6-8c9bad81d42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-90c361c8-e7fa-4054-923d-77ad4ef5f927 tempest-CreateVolumesFromImageTest-1142248136 None] Created volume successfully. Aug 26 03:18:18 devstack sudo[114267]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e 1073741824" returned: 0 in 0.552s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:18 devstack sudo[114273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e Aug 26 03:18:18 devstack sudo[114273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:18 devstack sudo[114273]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e" returned: 0 in 0.275s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.054s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-481637032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d6d572f-949a-4f85-88ab-4da0fc4f26a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:16Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Creating volume 7d6d572f-949a-4f85-88ab-4da0fc4f26a0 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:18 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4708ced-55dd-430a-b8cf-7e859295b2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d48cd885-7c69-4bcd-84c9-43fd7820803e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:18 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 1073741824 Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9209be28-5d61-45f6-9cf7-9150a9db4195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:18 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:18 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Volume volume-d48cd885-7c69-4bcd-84c9-43fd7820803e (d48cd885-7c69-4bcd-84c9-43fd7820803e): created successfully Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9209be28-5d61-45f6-9cf7-9150a9db4195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Flow 'volume_create_manager' (09ce38f9-2217-488c-af80-cd51773d5393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:18 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3800e233-92b1-4cec-b80a-f8609cb129f4 tempest-CinderUnicodeTest-1798998123 None] Created volume successfully. Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Flow 'volume_create_manager' (76f35573-cb45-4573-9617-b780f94d4032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2cbde4-9c44-43a0-88a3-672ae2109081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce2cbde4-9c44-43a0-88a3-672ae2109081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6457561615d84a459107b6f952dc394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:19Z,use_quota=True,user_id='790a96e477e1457cb6ab2b5e542a3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd50f0a1-37c3-4373-8223-e337f2d24df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd50f0a1-37c3-4373-8223-e337f2d24df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee8d153-19fe-4617-9eaa-517646361a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:18:19 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 1073741824" returned: 0 in 0.666s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:19 devstack sudo[114282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 Aug 26 03:18:19 devstack sudo[114282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee8d153-19fe-4617-9eaa-517646361a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2e44cfc-b2fc-4491-82ca-f2a540e7c5f6', 'volume_name': 'volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6', 'volume_size': 1, 'image_id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2c60f53-1732-4532-8d70-4d7e3a443aff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2078dca55c59f8864624ebb0e35a4477', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6457561615d84a459107b6f952dc394a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a19a54f01a10470b37c3a25470c8bb5e821e4ccce249c682487bf5ab89846a2c78e5ca028c9752ac279c49affb82a5e42e97a820ef9479928507daa4717321c', 'id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'created_at': datetime.datetime(2026, 8, 26, 1, 18, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 18, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2c60f53-1732-4532-8d70-4d7e3a443aff/file', 'properties': {}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea3214-724d-4ef5-afe2-39394cdf53c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cea3214-724d-4ef5-afe2-39394cdf53c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3838039e-9110-4827-a0f3-fac445533b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Volume d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6', 'volume_size': 1, 'image_id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2c60f53-1732-4532-8d70-4d7e3a443aff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2078dca55c59f8864624ebb0e35a4477', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6457561615d84a459107b6f952dc394a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a19a54f01a10470b37c3a25470c8bb5e821e4ccce249c682487bf5ab89846a2c78e5ca028c9752ac279c49affb82a5e42e97a820ef9479928507daa4717321c', 'id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'created_at': datetime.datetime(2026, 8, 26, 1, 18, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 18, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2c60f53-1732-4532-8d70-4d7e3a443aff/file', 'properties': {}}, 'image_service': } Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Trying to clone d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 from image e2c60f53-1732-4532-8d70-4d7e3a443aff at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2c60f53-1732-4532-8d70-4d7e3a443aff', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:18:19 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:18:19 devstack sudo[114282]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0" returned: 0 in 0.352s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.732s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-951972274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a14f833-b693-4d9b-b67b-469a75ed46a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:17Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Creating volume 9a14f833-b693-4d9b-b67b-469a75ed46a3 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:19 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69aba91-d4f8-40cd-aba6-87de4b7ae414]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:19 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 1073741824 Aug 26 03:18:19 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Flow 'volume_create_manager' (0f0b0061-7d13-460b-aa81-53b6d15ef5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03954313-fd06-4bd9-83c2-5926d091fbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03954313-fd06-4bd9-83c2-5926d091fbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1976277421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecf33fd-84d7-42be-855b-59f79e71794f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf618f5f974dfd8727f1b89651934b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:20Z,use_quota=True,user_id='9982d895118f44638105d2d72363e3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9220971-cef0-49be-95b9-ed5734c46e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9220971-cef0-49be-95b9-ed5734c46e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79514f8-41f5-4501-b0e8-a50ebe123b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79514f8-41f5-4501-b0e8-a50ebe123b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ecf33fd-84d7-42be-855b-59f79e71794f', 'volume_name': 'volume-8ecf33fd-84d7-42be-855b-59f79e71794f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dac95d9-debd-49ca-87df-ef96654ac932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dac95d9-debd-49ca-87df-ef96654ac932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54a20e3-257e-49a2-a839-7fb40b9c2149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Volume 8ecf33fd-84d7-42be-855b-59f79e71794f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ecf33fd-84d7-42be-855b-59f79e71794f', 'volume_size': 1} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917d424c-6aab-4ad2-bde0-4469ac367937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9ee582-831d-4c74-87f5-ff0089b5dfb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:19 devstack sudo[114292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD Aug 26 03:18:19 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:19 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Volume volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 (7d6d572f-949a-4f85-88ab-4da0fc4f26a0): created successfully Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9ee582-831d-4c74-87f5-ff0089b5dfb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:19 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (93fdbccd-3ba8-4b8c-9b46-09bc9e89a1cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-278e0a2f-6bd4-47f2-9f87-c255d88c25e3 tempest-CreateVolumesFromImageTest-1142248136 None] Created volume successfully. Aug 26 03:18:20 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:20 devstack sudo[114301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD Aug 26 03:18:20 devstack sudo[114301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:20 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 1073741824" returned: 0 in 0.552s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack sudo[114302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:20 devstack sudo[114302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:20 devstack sudo[114305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 Aug 26 03:18:20 devstack sudo[114305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Flow 'volume_create_manager' (1c5d04b3-b30f-4353-aa50-38d1a0bb6624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0e1f22-c1fe-4b51-8b98-6bf7e9de28f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0e1f22-c1fe-4b51-8b98-6bf7e9de28f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572fe9d827db4233b639fe01605e5432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:20Z,use_quota=True,user_id='36971c96969745359b6e9ac713aac72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a8021d9-4f1c-4194-bdd8-8e6d5acd15da),volume_type_id=6a8021d9-4f1c-4194-bdd8-8e6d5acd15da)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack sudo[114301]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84415e13-85d4-472c-8984-b45350adadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:20 devstack sudo[114302]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84415e13-85d4-472c-8984-b45350adadfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83770bb-71dd-4492-8d8b-766574d38706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.image.glance [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Creating Keystone auth plugin from conf {{(pid=94506) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.289s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD" returned: 1 in 0.381s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Temporary image e2c60f53-1732-4532-8d70-4d7e3a443aff is fetched for user 790a96e477e1457cb6ab2b5e542a3de5. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:18:20 devstack sudo[114305]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.162s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-129819463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e019bd6-2af6-4a92-a573-a0bc15211116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a9463d051944a48604d9ff11da82d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:17Z,use_quota=True,user_id='41980baa64cc429eb6d249e354d30039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Creating volume 3e019bd6-2af6-4a92-a573-a0bc15211116 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:20 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:20 devstack sudo[114312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 1073741824 Aug 26 03:18:20 devstack sudo[114312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0abe6b3b-41a0-43ee-b7a7-e442fa5e8714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a14f833-b693-4d9b-b67b-469a75ed46a3', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651ceca3-18d7-4c03-8bdb-f5d217c4a437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[740cd031-c18f-4ce6-bf71-d60f5bcbee64]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:20 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Volume volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 (9a14f833-b693-4d9b-b67b-469a75ed46a3): created successfully Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651ceca3-18d7-4c03-8bdb-f5d217c4a437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (f8eb3bb7-d614-4f8e-bbba-d748568e59aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:20 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3210bbbf-055b-4dd6-838d-59b4b6ebdc97 tempest-CreateVolumesFromImageTest-1142248136 None] Created volume successfully. Aug 26 03:18:20 devstack sudo[114315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD Aug 26 03:18:20 devstack sudo[114315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83770bb-71dd-4492-8d8b-766574d38706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d', 'volume_name': 'volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d', 'volume_size': 1, 'image_id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92a9be2a70fe9e716e911ef38afe1d4f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '572fe9d827db4233b639fe01605e5432', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d97a1ef37e45c2c326ec5734419f3c67c05d498538a4f264b592e6e8c3cd079c4b922c1cb6a4d1f8c38e8358492b5c7b848021b97f632d2b0c9c0cf5fc547dc', 'id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'created_at': datetime.datetime(2026, 8, 26, 1, 18, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 18, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a248d75b-e2a3-4d91-818c-36b528d2976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a248d75b-e2a3-4d91-818c-36b528d2976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c80e38-b18a-4cef-9b3a-6c1eeec2ec9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Volume 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d', 'volume_size': 1, 'image_id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92a9be2a70fe9e716e911ef38afe1d4f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '572fe9d827db4233b639fe01605e5432', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d97a1ef37e45c2c326ec5734419f3c67c05d498538a4f264b592e6e8c3cd079c4b922c1cb6a4d1f8c38e8358492b5c7b848021b97f632d2b0c9c0cf5fc547dc', 'id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'created_at': datetime.datetime(2026, 8, 26, 1, 18, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 18, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Trying to clone 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d from image 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'metadata': {}}]). {{(pid=94506) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 26 03:18:21 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Image download 0.00 MB at 0.00 MB/s Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2a2c6e-36c2-4e63-b0a4-db62800afe13]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[114315]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[114323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD Aug 26 03:18:21 devstack sudo[114323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:21 devstack sudo[114312]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 1073741824" returned: 0 in 0.609s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack sudo[114324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD Aug 26 03:18:21 devstack sudo[114324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[114327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 Aug 26 03:18:21 devstack sudo[114327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:21 devstack sudo[114323]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[114324]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:21 devstack sudo[114327]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116" returned: 0 in 0.249s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1976277421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecf33fd-84d7-42be-855b-59f79e71794f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0bf618f5f974dfd8727f1b89651934b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:20Z,use_quota=True,user_id='9982d895118f44638105d2d72363e3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Creating volume 8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:21 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:21 devstack sudo[114336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f 1073741824 Aug 26 03:18:21 devstack sudo[114336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b53a47-f72e-4549-a557-0b6deb3e8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e019bd6-2af6-4a92-a573-a0bc15211116', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8abc103-53e2-49b6-a6ac-98245ad2fe6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:21 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Volume volume-3e019bd6-2af6-4a92-a573-a0bc15211116 (3e019bd6-2af6-4a92-a573-a0bc15211116): created successfully Aug 26 03:18:21 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD Aug 26 03:18:21 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8abc103-53e2-49b6-a6ac-98245ad2fe6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Flow 'volume_create_manager' (2e76ebc4-c98d-47db-89a0-56c07f1f6546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-43bda19c-e3bd-4959-bb07-8e4abfccc178 tempest-CreateVolumesFromImageTest-1142248136 None] Created volume successfully. Aug 26 03:18:21 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Temporary image 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 is fetched for user 36971c96969745359b6e9ac713aac72c. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8ca8a7-ff65-4641-b421-3e12004d4455]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-3e019bd6-2af6-4a92-a573-a0bc15211116-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-3e019bd6-2af6-4a92-a573-a0bc15211116-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-quobyte-3e019bd6-2af6-4a92-a573-a0bc15211116" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:22 devstack sudo[114345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD Aug 26 03:18:22 devstack sudo[114345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-3e019bd6-2af6-4a92-a573-a0bc15211116" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:22 devstack sudo[114336]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f 1073741824" returned: 0 in 0.508s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[26314316-0247-4101-9a86-d24b6b980782]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f Aug 26 03:18:22 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 Aug 26 03:18:22 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack sudo[114345]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack sudo[114354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD Aug 26 03:18:22 devstack sudo[114354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f" returned: 0 in 0.268s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.878s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6457561615d84a459107b6f952dc394a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:19Z,use_quota=True,user_id='790a96e477e1457cb6ab2b5e542a3de5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Creating volume d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:22 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c54a20e3-257e-49a2-a839-7fb40b9c2149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ecf33fd-84d7-42be-855b-59f79e71794f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:22 devstack sudo[114359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 1073741824 Aug 26 03:18:22 devstack sudo[114359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d061e84d-5359-4f12-a31d-7efc16383738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:22 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Volume volume-8ecf33fd-84d7-42be-855b-59f79e71794f (8ecf33fd-84d7-42be-855b-59f79e71794f): created successfully Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d061e84d-5359-4f12-a31d-7efc16383738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Flow 'volume_create_manager' (0f0b0061-7d13-460b-aa81-53b6d15ef5bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:22 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116" returned: 0 in 0.405s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3165d82f-713a-48e6-94f5-09aa51c0dad4 tempest-CinderUnicodeTest-1798998123 None] Created volume successfully. Aug 26 03:18:22 devstack sudo[114362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116 Aug 26 03:18:22 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack sudo[114354]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:22 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3e019bd6-2af6-4a92-a573-a0bc15211116" returned: 0 in 0.251s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-3e019bd6-2af6-4a92-a573-a0bc15211116" released by "delete_volume" :: held 0.696s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Created reservations ['b8f7bd4f-a2d1-4fac-acca-cd8bf0e6e6e5', 'ff215f96-fe39-4fab-adf9-b7b8e90553c5', 'bc4cb4aa-84f6-481e-9065-a22c99d3865c', 'a0f8be79-8de6-4968-b28f-9f2e49ea4ff5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:22 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:22 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:22 devstack sudo[114359]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 1073741824" returned: 0 in 0.515s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack sudo[114373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 Aug 26 03:18:23 devstack sudo[114373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-9a14f833-b693-4d9b-b67b-469a75ed46a3-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-9a14f833-b693-4d9b-b67b-469a75ed46a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:23 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.361s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-quobyte-9a14f833-b693-4d9b-b67b-469a75ed46a3" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:23 devstack sudo[114373]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Deleted volume successfully. Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" returned: 0 in 0.294s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='572fe9d827db4233b639fe01605e5432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:20Z,use_quota=True,user_id='36971c96969745359b6e9ac713aac72c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6a8021d9-4f1c-4194-bdd8-8e6d5acd15da),volume_type_id=6a8021d9-4f1c-4194-bdd8-8e6d5acd15da)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Creating volume 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:23 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-9a14f833-b693-4d9b-b67b-469a75ed46a3" acquired by "delete_volume" :: waited 0.057s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:23 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d 1073741824 Aug 26 03:18:23 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b838dff4-e73f-477a-a20e-1644f62e30ea tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-3e019bd6-2af6-4a92-a573-a0bc15211116-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Attempting download of e2c60f53-1732-4532-8d70-4d7e3a443aff ((None, [{'url': 'file:///opt/stack/data/glance/images/e2c60f53-1732-4532-8d70-4d7e3a443aff', 'metadata': {}}])) to volume d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[404445c7-175e-4189-9494-74c86c21c042]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec869588-b971-49ff-94b7-10314a33611f]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack sudo[114379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 Aug 26 03:18:23 devstack sudo[114379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack sudo[114381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg Aug 26 03:18:23 devstack sudo[114381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack sudo[114379]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3" returned: 0 in 0.375s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack sudo[114381]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg" returned: 0 in 0.348s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3 Aug 26 03:18:23 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d 1073741824" returned: 0 in 0.470s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:23 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d Aug 26 03:18:23 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:23 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg Aug 26 03:18:23 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9a14f833-b693-4d9b-b67b-469a75ed46a3" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-9a14f833-b693-4d9b-b67b-469a75ed46a3" released by "delete_volume" :: held 0.718s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:24 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" returned: 0 in 0.301s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.963s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:24 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg" returned: 1 in 0.390s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2c60f53-1732-4532-8d70-4d7e3a443aff_2jg24spg' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Creating offline snapshot 6e0dff90-57f7-4c01-bc82-a20f3569a6a3 of volume 8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42f6df0-ea58-49f3-afca-930e05c254ab]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Created reservations ['5fa5314a-fdf3-4764-8e7a-d279f5f1fd1d', 'd7ea913f-5e81-4717-973c-039bbea71389', '9aef6e32-0764-4491-b1b8-2ae8092713f1', '50d9f8ea-d4ce-45f6-83e7-ac23d3ca4a0f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Attempting download of 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'metadata': {}}])) to volume 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5d076b-a50f-4d66-97fd-9c7228a9194a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ad8db-7242-4393-9d27-8408507ce361]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack sudo[114402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD Aug 26 03:18:24 devstack sudo[114402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack sudo[114403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f Aug 26 03:18:24 devstack sudo[114403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack sudo[114406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:24 devstack sudo[114406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-7d6d572f-949a-4f85-88ab-4da0fc4f26a0-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-7d6d572f-949a-4f85-88ab-4da0fc4f26a0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:24 devstack sudo[114404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8 Aug 26 03:18:24 devstack sudo[114404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-quobyte-7d6d572f-949a-4f85-88ab-4da0fc4f26a0" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-7d6d572f-949a-4f85-88ab-4da0fc4f26a0" acquired by "delete_volume" :: waited 0.040s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[20989976-08dd-41ab-af5e-6dd98df0af1d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack sudo[114402]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD" returned: 0 in 0.508s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack sudo[114403]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f" returned: 0 in 0.503s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack sudo[114418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 1G Aug 26 03:18:24 devstack sudo[114418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack sudo[114406]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.424s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:24 devstack sudo[114404]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8" returned: 0 in 0.511s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:24 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Deleted volume successfully. Aug 26 03:18:24 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 Aug 26 03:18:24 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack sudo[114416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD Aug 26 03:18:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d6bff82a-becf-442e-b90a-1b610657cd79 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-9a14f833-b693-4d9b-b67b-469a75ed46a3-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:24 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:24 devstack sudo[114422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8 Aug 26 03:18:24 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD" returned: 1 in 0.390s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] e2c60f53-1732-4532-8d70-4d7e3a443aff was raw, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:18:25 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0" returned: 0 in 0.476s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 Aug 26 03:18:25 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0 Aug 26 03:18:25 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[114418]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8" returned: 1 in 0.424s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_4bpyrtg8' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 1G" returned: 0 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ecf33fd-84d7-42be-855b-59f79e71794f -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeb5a88-85e8-4610-8eed-a70b2fd91ecc]: (4, 'raw') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[114442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ecf33fd-84d7-42be-855b-59f79e71794f -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 Aug 26 03:18:25 devstack sudo[114442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[114443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD Aug 26 03:18:25 devstack sudo[114443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-7d6d572f-949a-4f85-88ab-4da0fc4f26a0" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-7d6d572f-949a-4f85-88ab-4da0fc4f26a0" released by "delete_volume" :: held 0.809s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Created reservations ['7b51df6d-59e0-450e-b361-ef914502262f', '685e51f9-e6c1-44da-b251-179c1ed2fd67', '28f73c7f-644c-4800-babf-70c5b8e250c2', '7394465e-dd93-45f5-afbe-b831ecdc26be'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[114442]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ecf33fd-84d7-42be-855b-59f79e71794f -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3" returned: 0 in 0.370s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 is being set with open permissions: ugo+rw Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:25 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack sudo[114443]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack sudo[114458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 Aug 26 03:18:25 devstack sudo[114458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:25 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" returned: 0 in 0.633s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2c60f53-1732-4532-8d70-4d7e3a443aff_hjl4nly_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:18:25 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[114461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 1G Aug 26 03:18:25 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-quobyte-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:25 devstack sudo[114460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD Aug 26 03:18:25 devstack sudo[114460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af4ec31-3619-4372-9e0f-8d9c02ea05e4]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:25 devstack sudo[114458]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3" returned: 0 in 0.330s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:25 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=87,cinder:INSERT=34,cinder:UPDATE=110,cinder:DELETE=8 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:18:26 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.429s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Deleted volume successfully. Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 Aug 26 03:18:26 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-545eaea5-fae6-437c-92d4-447da7e2feb8 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-7d6d572f-949a-4f85-88ab-4da0fc4f26a0-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:26 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info Aug 26 03:18:26 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack sudo[114460]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD" returned: 1 in 0.514s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD' failed. Not Retrying. {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 was raw, converting to qcow2 {{(pid=94506) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack sudo[114476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d Aug 26 03:18:26 devstack sudo[114476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 1G" returned: 0 in 0.442s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Downloaded image e2c60f53-1732-4532-8d70-4d7e3a443aff ((None, [{'url': 'file:///opt/stack/data/glance/images/e2c60f53-1732-4532-8d70-4d7e3a443aff', 'metadata': {}}])) to volume d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Temporary image e2c60f53-1732-4532-8d70-4d7e3a443aff for user 790a96e477e1457cb6ab2b5e542a3de5 is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Marking volume d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=103,cinder:SELECT=89,cinder:INSERT=34,cinder:DELETE=10 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Copying metadata from image e2c60f53-1732-4532-8d70-4d7e3a443aff to d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Creating volume glance metadata for volume d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 backed by image e2c60f53-1732-4532-8d70-4d7e3a443aff with: {'image_id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2078dca55c59f8864624ebb0e35a4477', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:18:26 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info" returned: 0 in 0.304s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info is being set with open permissions: ugo+rw Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3838039e-9110-4827-a0f3-fac445533b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6', 'volume_size': 1, 'image_id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2c60f53-1732-4532-8d70-4d7e3a443aff', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2078dca55c59f8864624ebb0e35a4477', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6457561615d84a459107b6f952dc394a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2a19a54f01a10470b37c3a25470c8bb5e821e4ccce249c682487bf5ab89846a2c78e5ca028c9752ac279c49affb82a5e42e97a820ef9479928507daa4717321c', 'id': 'e2c60f53-1732-4532-8d70-4d7e3a443aff', 'created_at': datetime.datetime(2026, 8, 26, 1, 18, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 18, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2c60f53-1732-4532-8d70-4d7e3a443aff/file', 'properties': {}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:26 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecfdfb6-8d52-4ee9-bdb5-72c9b360b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:26 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Volume volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 (d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6): created successfully Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecfdfb6-8d52-4ee9-bdb5-72c9b360b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:26 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Flow 'volume_create_manager' (76f35573-cb45-4573-9617-b780f94d4032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38" returned: 0 in 0.493s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-eb75e09a-6729-406d-a752-32a4d151325d tempest-VolumeImageDependencyTests-768573139 None] Created volume successfully. Aug 26 03:18:26 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38 Aug 26 03:18:26 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.info" returned: 0 in 0.314s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.499s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:26 devstack sudo[114476]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" returned: 0 in 0.519s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2e03c79e-2bd2-43ce-8317-0a39fc7902f0_rbteuyxodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:18:26 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Converted 0.00 MB image at 0.00 MB/s Aug 26 03:18:26 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38" returned: 0 in 0.319s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:26 devstack sudo[114491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d 1G Aug 26 03:18:26 devstack sudo[114491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38" released by "delete_volume" :: held 0.872s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9c474e5b-d3a9-4112-b363-1c3bb3c7560d tempest-CinderUnicodeTest-1798998123 None] Create snapshot completed successfully Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Created reservations ['910da1ed-c33e-479a-878b-2b2d2601135c', 'ceaf7e57-954b-40fb-8a76-2256fd310c12', 'f4eeb49b-31ae-418a-85ae-21b0a8092a80', '8ff9f1e6-8d86-432f-bb88-4d11caeff812'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Acquiring lock "cinder-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Lock "cinder-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-095ccb79-4e0a-452b-b916-4f6aae24fbf8-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:26 devstack sudo[114493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:26 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Acquiring lock "cinder-quobyte-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-095ccb79-4e0a-452b-b916-4f6aae24fbf8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Lock "cinder-quobyte-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f2703-a41f-40d1-91f9-bb970238cbe9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "cinder-quobyte-095ccb79-4e0a-452b-b916-4f6aae24fbf8" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-095ccb79-4e0a-452b-b916-4f6aae24fbf8" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7515a-6a70-4e5b-96fa-c7bb36cfc608]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack sudo[114491]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d 1G" returned: 0 in 0.491s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Downloaded image 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 ((None, [{'url': 'file:///opt/stack/data/glance/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'metadata': {}}])) to volume 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d successfully. {{(pid=94506) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Temporary image 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 for user 36971c96969745359b6e9ac713aac72c is deleted. {{(pid=94506) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.volume_utils [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Marking volume 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d as bootable. {{(pid=94506) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 26 03:18:27 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 Aug 26 03:18:27 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Copying metadata from image 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 to 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d. {{(pid=94506) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Creating volume glance metadata for volume 1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d backed by image 2e03c79e-2bd2-43ce-8317-0a39fc7902f0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '92a9be2a70fe9e716e911ef38afe1d4f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94506) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 26 03:18:27 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.376s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Deleted volume successfully. Aug 26 03:18:27 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 Aug 26 03:18:27 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283ac8db-277e-4dc6-98a8-f4ca37bc777c tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-acb33ace-6cdb-4c33-bfc4-10e4c10c2b38-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c80e38-b18a-4cef-9b3a-6c1eeec2ec9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d', 'volume_size': 1, 'image_id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '92a9be2a70fe9e716e911ef38afe1d4f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '572fe9d827db4233b639fe01605e5432', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0d97a1ef37e45c2c326ec5734419f3c67c05d498538a4f264b592e6e8c3cd079c4b922c1cb6a4d1f8c38e8358492b5c7b848021b97f632d2b0c9c0cf5fc547dc', 'id': '2e03c79e-2bd2-43ce-8317-0a39fc7902f0', 'created_at': datetime.datetime(2026, 8, 26, 1, 18, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 26, 1, 18, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2e03c79e-2bd2-43ce-8317-0a39fc7902f0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e026e747-f18f-40be-9371-af9ce2efd3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Volume volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d (1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d): created successfully Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e026e747-f18f-40be-9371-af9ce2efd3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Flow 'volume_create_manager' (1c5d04b3-b30f-4353-aa50-38d1a0bb6624) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-59c5af5f-c402-4ddd-8cea-c35d402b5042 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Created volume successfully. Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-6e0dff90-57f7-4c01-bc82-a20f3569a6a3-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-6e0dff90-57f7-4c01-bc82-a20f3569a6a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-quobyte-8ecf33fd-84d7-42be-855b-59f79e71794f" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-8ecf33fd-84d7-42be-855b-59f79e71794f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-quobyte-6e0dff90-57f7-4c01-bc82-a20f3569a6a3" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-6e0dff90-57f7-4c01-bc82-a20f3569a6a3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Deleting offline snapshot 6e0dff90-57f7-4c01-bc82-a20f3569a6a3 of volume 8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] snapshot_file for this snap is: volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ddd9c9-e255-4da3-9243-2ba38669fa84]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" returned: 0 in 0.551s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6 Aug 26 03:18:27 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8" returned: 0 in 0.482s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:27 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8 Aug 26 03:18:27 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 Aug 26 03:18:27 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:27 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Lock "cinder-quobyte-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6" released by "delete_volume" :: held 0.856s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:27 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-095ccb79-4e0a-452b-b916-4f6aae24fbf8" returned: 0 in 0.259s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-quobyte-095ccb79-4e0a-452b-b916-4f6aae24fbf8" released by "delete_volume" :: held 0.799s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Created reservations ['ea50c0e1-6d4b-479a-aa64-e51fa9514b3a', 'e6ae43a2-3dfb-488f-8a7f-688c87e342e8', 'e6163180-7796-4547-8423-7365d8d1dc45', '6147dd96-83ce-44ce-a430-067ede4df2d7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:27 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Created reservations ['cd6a09b4-3476-4656-af55-5340019aab8b', 'c9b12a89-89f4-4767-91c6-5cf11d9d6d8c', '3abf6f4d-a11f-466c-a465-8e03fd08e2ea', '04b39c52-a083-499b-9f38-d60b48c9c9f7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:28 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ecf33fd-84d7-42be-855b-59f79e71794f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Acquiring lock "cinder-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5612f515-7a50-45f5-b621-81b641189698]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "cinder-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:28 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Acquiring lock "cinder-quobyte-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:28 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f Aug 26 03:18:28 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:28 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "cinder-quobyte-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb8d48e-8273-44b1-a771-dec86a334b77]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack sudo[114527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d Aug 26 03:18:28 devstack sudo[114527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.453s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:28 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Deleted volume successfully. Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.389s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Deleted volume successfully. Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-83e0bc09-7c7c-471d-95ef-0f829eabe562 tempest-VolumeImageDependencyTests-768573139 None] Lock "cinder-d2e44cfc-b2fc-4491-82ca-f2a540e7c5f6-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4489e21b-59fc-44c2-a518-c9cc4d5d8ac7 tempest-CreateVolumesFromImageTest-1142248136 None] Lock "cinder-095ccb79-4e0a-452b-b916-4f6aae24fbf8-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:28 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f" returned: 0 in 0.822s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:28 devstack sudo[114572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 Aug 26 03:18:28 devstack sudo[114572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:28 devstack sudo[114527]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" returned: 0 in 0.611s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:29 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d Aug 26 03:18:29 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:29 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" returned: 0 in 0.409s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "cinder-quobyte-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d" released by "delete_volume" :: held 1.088s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:29 devstack sudo[114572]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3" returned: 0 in 0.510s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:29 devstack sudo[114582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3 Aug 26 03:18:29 devstack sudo[114582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Created reservations ['5ecb3ab0-42f4-45cc-b404-d576230452c4', 'e6754498-565c-4878-ba0c-057613fb7746', '5ffbc17f-ae77-4c84-92e8-8c1bc07c933b', '71c59284-836f-4367-a3fd-1b1dc6d185b5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:29 devstack sudo[114584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:29 devstack sudo[114584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:29 devstack sudo[114582]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f.6e0dff90-57f7-4c01-bc82-a20f3569a6a3" returned: 0 in 0.365s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-6e0dff90-57f7-4c01-bc82-a20f3569a6a3" released by "_delete_snapshot" :: held 2.297s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-8ecf33fd-84d7-42be-855b-59f79e71794f" released by "delete_snapshot" :: held 2.332s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:29 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Created reservations ['502c9883-4f5d-493e-922a-28f2eabc637b', '8b7b6751-bea5-4931-be29-fabb235e1608', '1b744bd6-ad86-4cb2-b663-326a6d18a6f6', '9b3ea0e4-7b58-4cf8-817a-8e5910f5abf8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:30 devstack sudo[114584]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.348s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Deleted volume successfully. Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-51ac37ee-2e5f-4866-886c-cadbcc307c63 tempest-VolumeAndVolumeTypeFromImageTest-10131368 None] Lock "cinder-1235b43b-6b0d-41a2-ab8b-16ffa2fb9f3d-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Delete snapshot completed successfully. Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b4b9a988-0b45-410f-8e3b-098c34aecede tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-6e0dff90-57f7-4c01-bc82-a20f3569a6a3-delete_snapshot" released by "delete_snapshot" :: held 2.578s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-8ecf33fd-84d7-42be-855b-59f79e71794f-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-8ecf33fd-84d7-42be-855b-59f79e71794f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-quobyte-8ecf33fd-84d7-42be-855b-59f79e71794f" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-8ecf33fd-84d7-42be-855b-59f79e71794f" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c7c414-569f-408b-b002-a64ffe99ca16]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:31 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f Aug 26 03:18:31 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:31 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:31 devstack sudo[114594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f Aug 26 03:18:31 devstack sudo[114594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:31 devstack sudo[114594]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-8ecf33fd-84d7-42be-855b-59f79e71794f" returned: 0 in 0.264s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-8ecf33fd-84d7-42be-855b-59f79e71794f" released by "delete_volume" :: held 0.746s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Created reservations ['f09eacf0-f9ca-40fb-96a7-da8b68096d4f', '645a20b1-6d40-4d0c-8fe5-fb18c97ca7a3', '169395eb-3e40-4ce6-8a7b-10f328fb0b59', '7683c55b-3a21-4a11-ade3-7b98f7783e3b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:31 devstack sudo[114597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:31 devstack sudo[114597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-d48cd885-7c69-4bcd-84c9-43fd7820803e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:32 devstack sudo[114597]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.319s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Deleted volume successfully. Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-d48cd885-7c69-4bcd-84c9-43fd7820803e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dc281ab8-6faf-4f36-b583-00820f0329f3 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-8ecf33fd-84d7-42be-855b-59f79e71794f-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "cinder-quobyte-d48cd885-7c69-4bcd-84c9-43fd7820803e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-d48cd885-7c69-4bcd-84c9-43fd7820803e" acquired by "delete_volume" :: waited 0.036s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd04611a-8282-4e84-b34b-9981b9b1e1c0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:32 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e Aug 26 03:18:32 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:32 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e" returned: 0 in 0.464s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:32 devstack sudo[114605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e Aug 26 03:18:32 devstack sudo[114605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:32 devstack sudo[114605]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d48cd885-7c69-4bcd-84c9-43fd7820803e" returned: 0 in 0.284s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-quobyte-d48cd885-7c69-4bcd-84c9-43fd7820803e" released by "delete_volume" :: held 0.817s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Created reservations ['e6f07181-1711-4a99-91c4-006cf8c3a28f', '5f0e9e6b-0d4f-46b9-b62e-a9b35ca8a48d', '8dbf068e-73c2-4b44-8100-84a694afd95f', '27fb7d83-3b12-4895-9ba6-05439d7885af'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:33 devstack sudo[114608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:33 devstack sudo[114608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (47321512-8a22-4bef-8661-bf3c25ecebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7449a9c0-fa80-4a03-a400-d876f6da186b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7449a9c0-fa80-4a03-a400-d876f6da186b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1266828904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455a4a4-463d-4bbb-9939-6920aa93dbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:33Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac43d05-e739-43a4-ae43-4f782505d05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac43d05-e739-43a4-ae43-4f782505d05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0861adf8-2d65-430e-a08d-0b7eb47782e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0861adf8-2d65-430e-a08d-0b7eb47782e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4455a4a4-463d-4bbb-9939-6920aa93dbb5', 'volume_name': 'volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a73886-f6cb-41ef-ac6d-c8798f992343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4a73886-f6cb-41ef-ac6d-c8798f992343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2246d161-cf44-4b29-953e-a057305fabd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:33 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume 4455a4a4-463d-4bbb-9939-6920aa93dbb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5', 'volume_size': 1} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1266828904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455a4a4-463d-4bbb-9939-6920aa93dbb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:33Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating volume 4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:33 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:33 devstack sudo[114612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 1073741824 Aug 26 03:18:33 devstack sudo[114612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:33 devstack sudo[114608]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.371s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Deleted volume successfully. Aug 26 03:18:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20b037c2-92b2-4b33-9be4-da4a25ae8c55 tempest-CinderUnicodeTest-1798998123 None] Lock "cinder-d48cd885-7c69-4bcd-84c9-43fd7820803e-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:34 devstack sudo[114612]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 1073741824" returned: 0 in 0.605s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:34 devstack sudo[114618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 Aug 26 03:18:34 devstack sudo[114618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (b3e15ae2-4daf-46e7-a2d5-7ffd60b45e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d509a75-ca1d-4084-bdda-169546424314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d509a75-ca1d-4084-bdda-169546424314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088588953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062716fe-f3d2-4038-abc5-ffb7566bf659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:34Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb1f6e1-a937-4bcc-8fb6-71089d0d1849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deb1f6e1-a937-4bcc-8fb6-71089d0d1849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fd0e49-b0ba-4270-b414-1e439eb9acac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack sudo[114618]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fd0e49-b0ba-4270-b414-1e439eb9acac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '062716fe-f3d2-4038-abc5-ffb7566bf659', 'volume_name': 'volume-062716fe-f3d2-4038-abc5-ffb7566bf659', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e7fefc-85d3-4d49-add6-2070aa9bf80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e7fefc-85d3-4d49-add6-2070aa9bf80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea0f234-300f-4887-a9b7-89b76b0ce769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Volume 062716fe-f3d2-4038-abc5-ffb7566bf659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-062716fe-f3d2-4038-abc5-ffb7566bf659', 'volume_size': 1} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5" returned: 0 in 0.367s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2088588953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=062716fe-f3d2-4038-abc5-ffb7566bf659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:34Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Creating volume 062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:34 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2246d161-cf44-4b29-953e-a057305fabd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack sudo[114621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 1073741824 Aug 26 03:18:34 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98dd3ced-3d04-47af-ad1b-1f6ddbd64f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:34 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 (4455a4a4-463d-4bbb-9939-6920aa93dbb5): created successfully Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98dd3ced-3d04-47af-ad1b-1f6ddbd64f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:34 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (47321512-8a22-4bef-8661-bf3c25ecebb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:34 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-15aa1321-781b-4236-abff-6b163ab2a8ed tempest-CreateVolumesFromSnapshotTest-846708255 None] Created volume successfully. Aug 26 03:18:35 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 1073741824" returned: 0 in 0.531s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:35 devstack sudo[114627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 Aug 26 03:18:35 devstack sudo[114627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:35 devstack sudo[114627]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659" returned: 0 in 0.281s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea0f234-300f-4887-a9b7-89b76b0ce769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-062716fe-f3d2-4038-abc5-ffb7566bf659', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a85865-d6cc-457a-b651-35e8690ec7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:35 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Volume volume-062716fe-f3d2-4038-abc5-ffb7566bf659 (062716fe-f3d2-4038-abc5-ffb7566bf659): created successfully Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a85865-d6cc-457a-b651-35e8690ec7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (b3e15ae2-4daf-46e7-a2d5-7ffd60b45e70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-61ae3693-5e8e-4b9e-807a-e7061fa64c24 tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating offline snapshot debfc505-9e32-48d0-85ca-fe1e7ab7f0ac of volume 4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c1bdf1-650b-4606-a5ed-dbd6a28efbc0]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:35 devstack sudo[114630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 Aug 26 03:18:35 devstack sudo[114630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:36 devstack sudo[114630]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5" returned: 0 in 0.373s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:36 devstack sudo[114635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac 1G Aug 26 03:18:36 devstack sudo[114635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:36 devstack sudo[114635]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Flow 'volume_create_manager' (84d847f5-8a89-4747-a8d7-a4d5effb7e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3c9aa4-8c2a-4fce-9476-94419884df8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac 1G" returned: 0 in 0.581s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb3c9aa4-8c2a-4fce-9476-94419884df8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-436518251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e768e635-9189-4483-9b22-e0af7c87b523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9cbef759f4ce4953039d9abcbfdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:37Z,use_quota=True,user_id='7e5243a40de94b85afaecec6e1fa685b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:36 devstack sudo[114642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac Aug 26 03:18:36 devstack sudo[114642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77744bac-8664-4b88-bb0e-734210f03de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77744bac-8664-4b88-bb0e-734210f03de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa33520b-c52e-48b2-a23d-bb52890c1e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa33520b-c52e-48b2-a23d-bb52890c1e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e768e635-9189-4483-9b22-e0af7c87b523', 'volume_name': 'volume-e768e635-9189-4483-9b22-e0af7c87b523', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8993b44-59b5-47ff-9ae9-f5430699bd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8993b44-59b5-47ff-9ae9-f5430699bd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b13e67-9ca1-4609-8aa3-641e4b2c8948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Volume e768e635-9189-4483-9b22-e0af7c87b523: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e768e635-9189-4483-9b22-e0af7c87b523', 'volume_size': 1} Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:36 devstack sudo[114642]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" returned: 0 in 0.328s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:36 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac is being set with open permissions: ugo+rw Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:36 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac Aug 26 03:18:36 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:37 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" returned: 0 in 0.268s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:37 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info Aug 26 03:18:37 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-70da715a-f28e-4057-989d-8c2c778c5ebe tempest-ProjectAdminTests-626548596 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.8174476623535, 'free_capacity_gb': 1774.8174476623535, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94506) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 26 03:18:37 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:37 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info is being set with open permissions: ugo+rw Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:37 devstack sudo[114653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info Aug 26 03:18:37 devstack sudo[114653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:37 devstack sudo[114653]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.info" returned: 0 in 0.257s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.088s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-436518251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e768e635-9189-4483-9b22-e0af7c87b523,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9cbef759f4ce4953039d9abcbfdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:37Z,use_quota=True,user_id='7e5243a40de94b85afaecec6e1fa685b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Creating volume e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:37 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:37 devstack sudo[114656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 1073741824 Aug 26 03:18:37 devstack sudo[114656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-79cff286-b987-449e-98a9-84dd1b21b21b tempest-CreateVolumesFromSnapshotTest-846708255 None] Create snapshot completed successfully Aug 26 03:18:38 devstack sudo[114656]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 1073741824" returned: 0 in 0.457s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:38 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 Aug 26 03:18:38 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:38 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.617s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 5ab6501b-a064-43c7-aa79-b5c47ec02b75 of volume 062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4b13e67-9ca1-4609-8aa3-641e4b2c8948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e768e635-9189-4483-9b22-e0af7c87b523', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3976ab6-7c1c-4132-9263-84276a193c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6056ca-ac80-4e74-936b-b38e6d6523d5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Volume volume-e768e635-9189-4483-9b22-e0af7c87b523 (e768e635-9189-4483-9b22-e0af7c87b523): created successfully Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3976ab6-7c1c-4132-9263-84276a193c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Flow 'volume_create_manager' (84d847f5-8a89-4747-a8d7-a4d5effb7e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-dc0f3d91-153d-4cd7-b3fd-8bfe8ce93d76 tempest-VolumeDependencyTests-1871356646 None] Created volume successfully. Aug 26 03:18:38 devstack sudo[114664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 Aug 26 03:18:38 devstack sudo[114664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:39 devstack sudo[114664]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:39 devstack sudo[114669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 1G Aug 26 03:18:39 devstack sudo[114669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (d7e54771-04f3-4558-9c14-377b7bf237ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3671628-aaa6-4703-9e26-f2ef8ad194b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3671628-aaa6-4703-9e26-f2ef8ad194b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483400738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84ca8d3-5127-46ed-a53d-793ac13f22f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:39Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf19a9e-2de7-4067-a166-e7d82446b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf19a9e-2de7-4067-a166-e7d82446b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07729651-58b0-4a95-83fd-942e2a7a051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07729651-58b0-4a95-83fd-942e2a7a051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84ca8d3-5127-46ed-a53d-793ac13f22f2', 'volume_name': 'volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a5ec33-2d45-4b07-9851-fa4faac8edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a5ec33-2d45-4b07-9851-fa4faac8edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea04969-492e-4d23-a919-c8df789673e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume e84ca8d3-5127-46ed-a53d-793ac13f22f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2', 'volume_size': 1} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:39 devstack sudo[114669]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 1G" returned: 0 in 0.596s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062716fe-f3d2-4038-abc5-ffb7566bf659 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:39 devstack sudo[114674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062716fe-f3d2-4038-abc5-ffb7566bf659 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 Aug 26 03:18:39 devstack sudo[114674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (60ba4afa-dc98-4e6d-b1aa-ee4c529cbcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c44c882-cb84-41ce-a3e3-cfe333944126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c44c882-cb84-41ce-a3e3-cfe333944126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080836932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4aa943-ad8d-444f-8bf4-2e72ff2e4071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:40Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b388a05-25c4-441f-85e3-4a7de69606f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b388a05-25c4-441f-85e3-4a7de69606f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9814b2-24fe-4dab-9b48-5cddb74c1c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9814b2-24fe-4dab-9b48-5cddb74c1c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4aa943-ad8d-444f-8bf4-2e72ff2e4071', 'volume_name': 'volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061f56b5-2d81-4b53-a7ed-8e4bf3a6e5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (061f56b5-2d81-4b53-a7ed-8e4bf3a6e5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328cf3ff-77bd-416a-b1ab-ecf0acb9e79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume 3f4aa943-ad8d-444f-8bf4-2e72ff2e4071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071', 'volume_size': 1} Aug 26 03:18:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:40 devstack sudo[114674]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-062716fe-f3d2-4038-abc5-ffb7566bf659 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75" returned: 0 in 0.472s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:40 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 is being set with open permissions: ugo+rw Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack sudo[114679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 Aug 26 03:18:40 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (61cea619-4fb1-4ed3-b395-435019b900b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b13f3-6fb0-4306-a58f-a33f2f296b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d00b13f3-6fb0-4306-a58f-a33f2f296b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893033876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbffe49-a2e7-48d1-b450-8537882e2369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:40Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77614d9-87c5-4c8d-9c89-d45312bffc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77614d9-87c5-4c8d-9c89-d45312bffc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d750db4-4d4c-4f35-9f80-38726f2a1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d750db4-4d4c-4f35-9f80-38726f2a1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cbffe49-a2e7-48d1-b450-8537882e2369', 'volume_name': 'volume-2cbffe49-a2e7-48d1-b450-8537882e2369', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aa30dc-f6ef-457b-8d17-08f8fd0a4a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aa30dc-f6ef-457b-8d17-08f8fd0a4a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f170c12-38a8-4ff9-b357-06ca7525dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume 2cbffe49-a2e7-48d1-b450-8537882e2369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cbffe49-a2e7-48d1-b450-8537882e2369', 'volume_size': 1} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:40 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75" returned: 0 in 0.402s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:40 devstack sudo[114682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info Aug 26 03:18:40 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (0519ecf5-90e9-4346-83b4-0a8c996a357a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660cd35f-ab3c-473f-a72b-23b18431380d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660cd35f-ab3c-473f-a72b-23b18431380d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248828142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0df7bf9-e09a-4a55-a234-feaece65a312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:41Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceed0e5-5738-4d45-a51a-7f46638e8bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ceed0e5-5738-4d45-a51a-7f46638e8bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bc5164-43fa-424e-ad18-683289d72da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7bc5164-43fa-424e-ad18-683289d72da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0df7bf9-e09a-4a55-a234-feaece65a312', 'volume_name': 'volume-f0df7bf9-e09a-4a55-a234-feaece65a312', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5ff8c0-cd79-4afe-b3ef-2171bcbc0737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5ff8c0-cd79-4afe-b3ef-2171bcbc0737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a1c2be-1895-44a0-9876-1fd1baf332df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:40 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume f0df7bf9-e09a-4a55-a234-feaece65a312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0df7bf9-e09a-4a55-a234-feaece65a312', 'volume_size': 1} Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:40 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info" returned: 0 in 0.393s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:40 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info is being set with open permissions: ugo+rw Aug 26 03:18:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[114685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info Aug 26 03:18:41 devstack sudo[114685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack sudo[114685]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.info" returned: 0 in 0.333s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.731s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.844s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-483400738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e84ca8d3-5127-46ed-a53d-793ac13f22f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:39Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating volume e84ca8d3-5127-46ed-a53d-793ac13f22f2 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:41 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[114688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 1073741824 Aug 26 03:18:41 devstack sudo[114688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-159370b8-da90-418c-a7cd-c13523fbab75 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (7206b90c-e5d1-4aa9-83e9-a11a25b8fa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbeb1d3-55e8-4f42-9b16-8d112ae4b846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbeb1d3-55e8-4f42-9b16-8d112ae4b846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916887235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc71c80-f560-4e19-8083-305fc212a650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:41Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c77feb-93dc-4f11-be8d-e663d3ea840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c77feb-93dc-4f11-be8d-e663d3ea840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38778bc4-6876-4e70-a090-7961a36f7d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38778bc4-6876-4e70-a090-7961a36f7d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc71c80-f560-4e19-8083-305fc212a650', 'volume_name': 'volume-bbc71c80-f560-4e19-8083-305fc212a650', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976e3b94-0776-4625-88d6-2502bfc1afcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (976e3b94-0776-4625-88d6-2502bfc1afcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a98b723-15b8-498b-b652-103b3fa98727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume bbc71c80-f560-4e19-8083-305fc212a650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc71c80-f560-4e19-8083-305fc212a650', 'volume_size': 1} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:41 devstack sudo[114688]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 1073741824" returned: 0 in 0.455s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:41 devstack sudo[114694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 Aug 26 03:18:41 devstack sudo[114694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack sudo[114694]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2" returned: 0 in 0.252s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1080836932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4aa943-ad8d-444f-8bf4-2e72ff2e4071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:40Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating volume 3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:42 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 1073741824 Aug 26 03:18:42 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea04969-492e-4d23-a919-c8df789673e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbd9716-e8de-4374-a964-52fb0a219868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 (e84ca8d3-5127-46ed-a53d-793ac13f22f2): created successfully Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbd9716-e8de-4374-a964-52fb0a219868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (d7e54771-04f3-4558-9c14-377b7bf237ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-798fbc87-14f5-4c61-ab74-9d4d05bc79fb tempest-CreateVolumesFromSnapshotTest-846708255 None] Created volume successfully. Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-5ab6501b-a064-43c7-aa79-b5c47ec02b75-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-5ab6501b-a064-43c7-aa79-b5c47ec02b75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-062716fe-f3d2-4038-abc5-ffb7566bf659" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-062716fe-f3d2-4038-abc5-ffb7566bf659" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-5ab6501b-a064-43c7-aa79-b5c47ec02b75" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-5ab6501b-a064-43c7-aa79-b5c47ec02b75" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 5ab6501b-a064-43c7-aa79-b5c47ec02b75 of volume 062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b11b5-2dad-4035-9fb6-9d4c24d9f7d1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack sudo[114702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 Aug 26 03:18:42 devstack sudo[114702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 1073741824" returned: 0 in 0.521s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 Aug 26 03:18:42 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:42 devstack sudo[114702]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75" returned: 0 in 0.389s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-062716fe-f3d2-4038-abc5-ffb7566bf659(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a8de26-1dbd-4a30-aa5a-7442e7846cd6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:42 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071" returned: 0 in 0.264s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.799s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328cf3ff-77bd-416a-b1ab-ecf0acb9e79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c351b2-37ae-4334-b49e-a852a19d7c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Creating offline snapshot a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 of volume e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:43 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 (3f4aa943-ad8d-444f-8bf4-2e72ff2e4071): created successfully Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c351b2-37ae-4334-b49e-a852a19d7c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (60ba4afa-dc98-4e6d-b1aa-ee4c529cbcb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d949e778-734f-43b7-9e80-7d50fd880b89]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 Aug 26 03:18:43 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-382976b8-a262-4b93-a2d1-e4f4ba27f518 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created volume successfully. Aug 26 03:18:43 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 Aug 26 03:18:43 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659" returned: 0 in 0.386s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 Aug 26 03:18:43 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523" returned: 0 in 0.427s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 1G Aug 26 03:18:43 devstack sudo[114725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75" returned: 0 in 0.369s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75 Aug 26 03:18:43 devstack sudo[114731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:43 devstack sudo[114725]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 1G" returned: 0 in 0.480s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e768e635-9189-4483-9b22-e0af7c87b523 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:43 devstack sudo[114731]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:43 devstack sudo[114737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e768e635-9189-4483-9b22-e0af7c87b523 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 Aug 26 03:18:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659.5ab6501b-a064-43c7-aa79-b5c47ec02b75" returned: 0 in 0.292s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:43 devstack sudo[114737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-5ab6501b-a064-43c7-aa79-b5c47ec02b75" released by "_delete_snapshot" :: held 1.558s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-062716fe-f3d2-4038-abc5-ffb7566bf659" released by "delete_snapshot" :: held 1.586s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Created reservations ['0811460e-240e-455c-aecb-7ec13a58297b', 'eda593eb-78f0-49d8-b4c7-850cebb77b0b', 'd92cfd06-bfe1-436f-a603-928271f5b037', '830123e4-7bf5-493b-aa9d-e17a1822e8f2'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-67839f3e-46d0-41ce-b2e7-fd6286e69c9e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-5ab6501b-a064-43c7-aa79-b5c47ec02b75-delete_snapshot" released by "delete_snapshot" :: held 1.750s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:44 devstack sudo[114737]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e768e635-9189-4483-9b22-e0af7c87b523 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" returned: 0 in 0.325s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:44 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 is being set with open permissions: ugo+rw Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 Aug 26 03:18:44 devstack sudo[114742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack sudo[114742]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info Aug 26 03:18:44 devstack sudo[114745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-062716fe-f3d2-4038-abc5-ffb7566bf659-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Lock "cinder-062716fe-f3d2-4038-abc5-ffb7566bf659-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-062716fe-f3d2-4038-abc5-ffb7566bf659" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-062716fe-f3d2-4038-abc5-ffb7566bf659" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31d281d-2d2f-4f5e-9061-eaddf5247537]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 Aug 26 03:18:44 devstack sudo[114747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:44 devstack sudo[114745]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:44 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info is being set with open permissions: ugo+rw Aug 26 03:18:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:44 devstack sudo[114750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info Aug 26 03:18:44 devstack sudo[114750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114750]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.info" returned: 0 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack sudo[114747]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.657s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-893033876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cbffe49-a2e7-48d1-b450-8537882e2369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:40Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating volume 2cbffe49-a2e7-48d1-b450-8537882e2369 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:45 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659" returned: 0 in 0.494s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 1073741824 Aug 26 03:18:45 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659 Aug 26 03:18:45 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2ad23e5c-d36c-4ab5-bd83-6fd5524e877c tempest-VolumeDependencyTests-1871356646 None] Create snapshot completed successfully Aug 26 03:18:45 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-062716fe-f3d2-4038-abc5-ffb7566bf659" returned: 0 in 0.283s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-062716fe-f3d2-4038-abc5-ffb7566bf659" released by "delete_volume" :: held 0.843s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Created reservations ['d6b033b8-f1af-4fb3-b7a4-5733d3bed505', '23865561-c92c-4049-abb5-d0dbc9727f03', 'e6f7e976-6ad3-4d65-b9e8-ea29b5e5f4cb', '422bf5a8-87c3-47d9-90cc-75d40223e837'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:45 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 1073741824" returned: 0 in 0.547s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:45 devstack sudo[114767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 Aug 26 03:18:45 devstack sudo[114767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:45 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.333s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-aea518d3-bc44-482e-b67d-2e691fb49d2b tempest-ProjectMemberTests-1946280196 None] Lock "cinder-062716fe-f3d2-4038-abc5-ffb7566bf659-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:46 devstack sudo[114767]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369" returned: 0 in 0.446s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.290s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248828142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0df7bf9-e09a-4a55-a234-feaece65a312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:41Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating volume f0df7bf9-e09a-4a55-a234-feaece65a312 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:46 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:46 devstack sudo[114771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 1073741824 Aug 26 03:18:46 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f170c12-38a8-4ff9-b357-06ca7525dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cbffe49-a2e7-48d1-b450-8537882e2369', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a446c8-d769-46ba-a15a-ff5309fc5fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Flow 'volume_create_manager' (80f962da-f4cb-4901-bc9f-ac54bbb29d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805aa2aa-1c7d-4f46-8490-b3bf5ca62e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805aa2aa-1c7d-4f46-8490-b3bf5ca62e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-398097506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5fa165-6661-44fc-b39f-874ec7000330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9cbef759f4ce4953039d9abcbfdcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6ce662d-c4db-4c43-a1f7-b5e89bd70d65,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='7e5243a40de94b85afaecec6e1fa685b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d29c8b4-2923-473a-8bcf-f364c0694038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d29c8b4-2923-473a-8bcf-f364c0694038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a691923d-877d-4e31-b99e-00710ed0a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a691923d-877d-4e31-b99e-00710ed0a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de5fa165-6661-44fc-b39f-874ec7000330', 'volume_name': 'volume-de5fa165-6661-44fc-b39f-874ec7000330', 'volume_size': 1, 'snapshot_id': 'a6ce662d-c4db-4c43-a1f7-b5e89bd70d65'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfc111a-28f1-412a-8562-83d0e3d7af4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dfc111a-28f1-412a-8562-83d0e3d7af4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53befec5-0734-454d-a929-8f62e30bd4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Volume de5fa165-6661-44fc-b39f-874ec7000330: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de5fa165-6661-44fc-b39f-874ec7000330', 'volume_size': 1, 'snapshot_id': 'a6ce662d-c4db-4c43-a1f7-b5e89bd70d65'} Aug 26 03:18:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume volume-2cbffe49-a2e7-48d1-b450-8537882e2369 (2cbffe49-a2e7-48d1-b450-8537882e2369): created successfully Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a446c8-d769-46ba-a15a-ff5309fc5fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (61cea619-4fb1-4ed3-b395-435019b900b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8dd85fe3-84a1-421c-a4ef-f3a0531d1412 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created volume successfully. Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (e39697b3-5711-47ed-9d4c-b5f3e66dc27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40176a6-9844-4693-83cb-84a1da4b26f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40176a6-9844-4693-83cb-84a1da4b26f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500461255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9616bf39-fb9d-4bb1-a690-610a126cdd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194ee553-7f4c-44ad-a92d-10e48de0b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194ee553-7f4c-44ad-a92d-10e48de0b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5991d72d-9ecc-4a15-96ce-ff3a07e42693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5991d72d-9ecc-4a15-96ce-ff3a07e42693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9616bf39-fb9d-4bb1-a690-610a126cdd16', 'volume_name': 'volume-9616bf39-fb9d-4bb1-a690-610a126cdd16', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75f473f-0953-440b-b2bd-715c3cecaffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75f473f-0953-440b-b2bd-715c3cecaffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081f8080-89be-47aa-bd63-5dd5328b8b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Volume 9616bf39-fb9d-4bb1-a690-610a126cdd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9616bf39-fb9d-4bb1-a690-610a126cdd16', 'volume_size': 1} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:46 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 1073741824" returned: 0 in 0.488s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:46 devstack sudo[114777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 Aug 26 03:18:46 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312" returned: 0 in 0.251s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.548s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-916887235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc71c80-f560-4e19-8083-305fc212a650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='335a3bd6f4cc4f2685a3cc56ee3e86cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:41Z,use_quota=True,user_id='17730ddb70154d66be0e0980b072d9d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Creating volume bbc71c80-f560-4e19-8083-305fc212a650 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:47 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a1c2be-1895-44a0-9876-1fd1baf332df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0df7bf9-e09a-4a55-a234-feaece65a312', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b885281-9514-4369-a72e-4f00ed2f4ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 1073741824 Aug 26 03:18:47 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume volume-f0df7bf9-e09a-4a55-a234-feaece65a312 (f0df7bf9-e09a-4a55-a234-feaece65a312): created successfully Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b885281-9514-4369-a72e-4f00ed2f4ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (0519ecf5-90e9-4346-83b4-0a8c996a357a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5b7fade3-766c-4931-b370-01a0fed8ebea tempest-CreateVolumesFromSnapshotTest-846708255 None] Created volume successfully. Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (c37c7105-154f-430c-beea-02efa8a8be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6780c073-5a91-40e5-90be-786584b4d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6780c073-5a91-40e5-90be-786584b4d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131552647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0744dd86-038b-4ea8-a299-013db6b86f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:47Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e26a47-f153-4bd3-8fdd-7df252a808d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5e26a47-f153-4bd3-8fdd-7df252a808d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0394b1-195a-4468-8bb9-d5d3c7313a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca0394b1-195a-4468-8bb9-d5d3c7313a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0744dd86-038b-4ea8-a299-013db6b86f17', 'volume_name': 'volume-0744dd86-038b-4ea8-a299-013db6b86f17', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c99da-8430-4824-a5c3-e553ae5682cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de3c99da-8430-4824-a5c3-e553ae5682cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46617b24-ed51-43b4-894f-508baa3a7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Volume 0744dd86-038b-4ea8-a299-013db6b86f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0744dd86-038b-4ea8-a299-013db6b86f17', 'volume_size': 1} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:47 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 1073741824" returned: 0 in 0.439s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 Aug 26 03:18:47 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:47 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650" returned: 0 in 0.224s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.295s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-quobyte-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65-de5fa165-6661-44fc-b39f-874ec7000330" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a98b723-15b8-498b-b652-103b3fa98727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc71c80-f560-4e19-8083-305fc212a650', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225c4ca6-f068-4976-91d1-fb4b7d0b0ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65-de5fa165-6661-44fc-b39f-874ec7000330" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Creating volume de5fa165-6661-44fc-b39f-874ec7000330 from snapshot a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-quobyte-de5fa165-6661-44fc-b39f-874ec7000330" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Volume volume-bbc71c80-f560-4e19-8083-305fc212a650 (bbc71c80-f560-4e19-8083-305fc212a650): created successfully Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225c4ca6-f068-4976-91d1-fb4b7d0b0ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Flow 'volume_create_manager' (7206b90c-e5d1-4aa9-83e9-a11a25b8fa7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-de5fa165-6661-44fc-b39f-874ec7000330" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] snapshot: a6ce662d-c4db-4c43-a1f7-b5e89bd70d65, volume: de5fa165-6661-44fc-b39f-874ec7000330, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:18:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4a6f2766-52e7-419b-b5f9-6dffa041a855 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created volume successfully. Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a697c1-d9d8-4fc0-8619-cdc61d67a24f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:47 devstack sudo[114789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 Aug 26 03:18:47 devstack sudo[114789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-bbc71c80-f560-4e19-8083-305fc212a650-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-bbc71c80-f560-4e19-8083-305fc212a650-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-bbc71c80-f560-4e19-8083-305fc212a650" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-bbc71c80-f560-4e19-8083-305fc212a650" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[de103f57-d060-4262-81b0-134e198a07f3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 Aug 26 03:18:48 devstack sudo[114791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack sudo[114789]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" returned: 0 in 0.390s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e768e635-9189-4483-9b22-e0af7c87b523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[25679f44-79ba-4939-a8dc-f4114c9ad261]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 Aug 26 03:18:48 devstack sudo[114796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack sudo[114791]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650" returned: 0 in 0.361s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650 Aug 26 03:18:48 devstack sudo[114801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack sudo[114796]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523" returned: 0 in 0.345s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 Aug 26 03:18:48 devstack sudo[114806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:48 devstack sudo[114801]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-bbc71c80-f560-4e19-8083-305fc212a650" returned: 0 in 0.253s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-bbc71c80-f560-4e19-8083-305fc212a650" released by "delete_volume" :: held 0.652s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['928037c4-a85e-4e8a-8415-f19224af8aac', 'ba9e04f4-06db-4efa-86ac-25a35023f47a', '10957ec2-fd1f-48b3-9cfa-ae0e66f375a9', 'ebdddfe7-52d2-4e72-8186-2e309cd7cdc7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:48 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:48 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:49 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.416s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-f0df7bf9-e09a-4a55-a234-feaece65a312-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:49 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleted volume successfully. Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-f0df7bf9-e09a-4a55-a234-feaece65a312-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9dd3970e-6e8b-4255-8e87-fe3e12db35a5 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-bbc71c80-f560-4e19-8083-305fc212a650-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-f0df7bf9-e09a-4a55-a234-feaece65a312" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-f0df7bf9-e09a-4a55-a234-feaece65a312" acquired by "delete_volume" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f69746-cc5b-4cc7-9b0d-a8c9aae1dd91]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:49 devstack sudo[114822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 Aug 26 03:18:49 devstack sudo[114822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:50 devstack sudo[114822]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312" returned: 0 in 0.680s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:50 devstack sudo[114827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312 Aug 26 03:18:50 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:50 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f0df7bf9-e09a-4a55-a234-feaece65a312" returned: 0 in 0.524s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:50 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-f0df7bf9-e09a-4a55-a234-feaece65a312" released by "delete_volume" :: held 1.305s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:50 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['f053f1e3-49d8-414c-95c5-00fce4329513', 'f0c19bac-d597-4e8a-b67b-03aa1a4714b2', '5279abf9-8573-49dd-a5c4-bea48e735f65', '6a13c26c-982f-44d8-857a-3a4b34551ad9'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:51 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:51 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:51 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.401s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleted volume successfully. Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-56cc2acb-a9a4-4dbe-8fd8-f4015e30f1ea tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-f0df7bf9-e09a-4a55-a234-feaece65a312-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-2cbffe49-a2e7-48d1-b450-8537882e2369-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-2cbffe49-a2e7-48d1-b450-8537882e2369-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-2cbffe49-a2e7-48d1-b450-8537882e2369" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-2cbffe49-a2e7-48d1-b450-8537882e2369" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:52 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d67510-d792-44b1-a0c7-93957c5cf137]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:52 devstack sudo[114833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 Aug 26 03:18:52 devstack sudo[114833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:52 devstack sudo[114833]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369" returned: 0 in 0.634s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:52 devstack sudo[114838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369 Aug 26 03:18:52 devstack sudo[114838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:53 devstack sudo[114806]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330" returned: 0 in 4.641s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:18:53 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Converted 1024.00 MB image at 220.58 MB/s Aug 26 03:18:53 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 is being set with open permissions: ugo+rw Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:53 devstack sudo[114838]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2cbffe49-a2e7-48d1-b450-8537882e2369" returned: 0 in 0.581s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-2cbffe49-a2e7-48d1-b450-8537882e2369" released by "delete_volume" :: held 1.292s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:53 devstack sudo[114841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 Aug 26 03:18:53 devstack sudo[114841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['940f4306-5232-4277-aaef-baf6208a4218', 'b6abff49-484c-461c-9788-b0a284ed7244', 'd7b23872-ad2f-400e-baca-b86fffb61975', 'd566d406-7b43-488d-9532-be984a69b1dc'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:53 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:53 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:53 devstack sudo[114841]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-de5fa165-6661-44fc-b39f-874ec7000330" released by "_copy_volume_from_snapshot" :: held 5.729s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65-de5fa165-6661-44fc-b39f-874ec7000330" released by "_create_volume_from_snapshot" :: held 5.814s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.845s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.051s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500461255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9616bf39-fb9d-4bb1-a690-610a126cdd16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:46Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Creating volume 9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:53 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:53 devstack sudo[114849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 1073741824 Aug 26 03:18:53 devstack sudo[114849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53befec5-0734-454d-a929-8f62e30bd4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5fa165-6661-44fc-b39f-874ec7000330', 'volume_size': 1, 'snapshot_id': 'a6ce662d-c4db-4c43-a1f7-b5e89bd70d65'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:53 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8aba34-84ab-46b0-b0c2-c2a5c694101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:53 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Volume volume-de5fa165-6661-44fc-b39f-874ec7000330 (de5fa165-6661-44fc-b39f-874ec7000330): created successfully Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c8aba34-84ab-46b0-b0c2-c2a5c694101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Flow 'volume_create_manager' (80f962da-f4cb-4901-bc9f-ac54bbb29d6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleted volume successfully. Aug 26 03:18:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8e4e819e-ed41-46ce-8b0a-32ba9d0725f2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-2cbffe49-a2e7-48d1-b450-8537882e2369-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2072f91e-4e36-4421-a11e-091d22ca235e tempest-VolumeDependencyTests-1871356646 None] Created volume successfully. Aug 26 03:18:54 devstack sudo[114849]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 1073741824" returned: 0 in 0.465s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-quobyte-e768e635-9189-4483-9b22-e0af7c87b523" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-e768e635-9189-4483-9b22-e0af7c87b523" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-quobyte-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:54 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 Aug 26 03:18:54 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Deleting offline snapshot a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 of volume e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] snapshot_file for this snap is: volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b5d3c-2a8c-4e18-9b45-9159775f1e8a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:54 devstack sudo[114858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 Aug 26 03:18:54 devstack sudo[114858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:54 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.092s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1131552647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0744dd86-038b-4ea8-a299-013db6b86f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:18:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:18:47Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Creating volume 0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:18:54 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b710f1-3e0b-4191-8e4c-94590d8e2094]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:54 devstack sudo[114861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 1073741824 Aug 26 03:18:54 devstack sudo[114861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081f8080-89be-47aa-bd63-5dd5328b8b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9616bf39-fb9d-4bb1-a690-610a126cdd16', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4c4734-c884-413f-b1e6-9a680ef581a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:54 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Volume volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 (9616bf39-fb9d-4bb1-a690-610a126cdd16): created successfully Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db4c4734-c884-413f-b1e6-9a680ef581a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (e39697b3-5711-47ed-9d4c-b5f3e66dc27e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6e64fa52-b330-4f30-8f94-378741ae4e28 tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:18:54 devstack sudo[114858]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" returned: 0 in 0.403s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e768e635-9189-4483-9b22-e0af7c87b523(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:54 devstack sudo[114862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 Aug 26 03:18:54 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c47cae-c3ec-43d1-8c94-828662485a94]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:54 devstack sudo[114870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 Aug 26 03:18:54 devstack sudo[114870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:54 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071" returned: 0 in 0.440s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:54 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071 Aug 26 03:18:54 devstack sudo[114861]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:54 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 1073741824" returned: 0 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:55 devstack sudo[114879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 Aug 26 03:18:55 devstack sudo[114879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:55 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071" returned: 0 in 0.317s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071" released by "delete_volume" :: held 0.838s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['6e6ec40c-fb64-4105-a6b6-4dcadbd7b8a6', 'fa6e145b-5c22-4b65-ac12-afe0dafbeb96', '475bcb7c-8ecf-4d31-b962-ac7219e17105', 'fa75955c-0819-4dfd-b945-f88275dad66f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:55 devstack sudo[114879]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17" returned: 0 in 0.362s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:55 devstack sudo[114870]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523" returned: 0 in 0.702s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46617b24-ed51-43b4-894f-508baa3a7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0744dd86-038b-4ea8-a299-013db6b86f17', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:55 devstack sudo[114886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 Aug 26 03:18:55 devstack sudo[114886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d568700a-32d7-4adb-91a3-77e9557c2628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:18:55 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Volume volume-0744dd86-038b-4ea8-a299-013db6b86f17 (0744dd86-038b-4ea8-a299-013db6b86f17): created successfully Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d568700a-32d7-4adb-91a3-77e9557c2628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (c37c7105-154f-430c-beea-02efa8a8be1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:18:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-43210a2b-7e1a-46b5-a101-7b62472cbeae tempest-ProjectReaderTests-1767369721 None] Created volume successfully. Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:55 devstack sudo[114888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:55 devstack sudo[114888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 2c18dba2-88aa-46aa-8507-65a723160f1f of volume 9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c576e59-469f-4e16-8cce-d49a4501a1cc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:55 devstack sudo[114891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 Aug 26 03:18:55 devstack sudo[114891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:55 devstack sudo[114888]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.271s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:55 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleted volume successfully. Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-637a7269-a5b2-41fc-add5-022d03c8bd22 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-3f4aa943-ad8d-444f-8bf4-2e72ff2e4071-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:55 devstack sudo[114886]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" returned: 0 in 0.468s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:55 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65 Aug 26 03:18:55 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:56 devstack sudo[114891]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16" returned: 0 in 0.439s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:56 devstack sudo[114903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f 1G Aug 26 03:18:56 devstack sudo[114903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:56 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523.a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" returned: 0 in 0.282s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65" released by "_delete_snapshot" :: held 1.990s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-e768e635-9189-4483-9b22-e0af7c87b523" released by "delete_snapshot" :: held 2.024s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Created reservations ['a3358787-41c6-4997-a903-dc95e2d625e2', '57f89d23-11e7-4263-a099-3472514c7830', '9db3d5a6-b2fa-4e41-ab05-008767d16251', '9031736d-6992-4d8e-87e2-e23ffa5a288b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:56 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Delete snapshot completed successfully. Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f87c2231-67d1-4869-a6fa-1ad9918ffbc8 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-a6ce662d-c4db-4c43-a1f7-b5e89bd70d65-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:56 devstack sudo[114903]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f 1G" returned: 0 in 0.450s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:56 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f Aug 26 03:18:56 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-e84ca8d3-5127-46ed-a53d-793ac13f22f2-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-e84ca8d3-5127-46ed-a53d-793ac13f22f2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-e84ca8d3-5127-46ed-a53d-793ac13f22f2" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-e84ca8d3-5127-46ed-a53d-793ac13f22f2" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a286f95-f8f5-4127-9874-c47bdc85ecbe]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:56 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f" returned: 0 in 0.301s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:56 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f is being set with open permissions: ugo+rw Aug 26 03:18:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:56 devstack sudo[114912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 Aug 26 03:18:56 devstack sudo[114912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:56 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f Aug 26 03:18:56 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f" returned: 0 in 0.240s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:57 devstack sudo[114912]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2" returned: 0 in 0.372s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack sudo[114923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2 Aug 26 03:18:57 devstack sudo[114923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack sudo[114924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info Aug 26 03:18:57 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack sudo[114923]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e84ca8d3-5127-46ed-a53d-793ac13f22f2" returned: 0 in 0.265s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-e84ca8d3-5127-46ed-a53d-793ac13f22f2" released by "delete_volume" :: held 0.690s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-e768e635-9189-4483-9b22-e0af7c87b523-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:57 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info" returned: 0 in 0.334s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:57 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info is being set with open permissions: ugo+rw Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-e768e635-9189-4483-9b22-e0af7c87b523-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:57 devstack sudo[114929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info Aug 26 03:18:57 devstack sudo[114929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['2205ebba-9a50-431f-8a4e-2b1ffcda7036', 'c999f6ac-f892-4f8e-b274-d0980f3e8a2f', 'bb74b0d4-4bf3-4d6b-bce9-ec39b07fa6c3', '5037c3e6-cd06-4ae5-b2ff-fd83da4138a2'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-quobyte-e768e635-9189-4483-9b22-e0af7c87b523" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-e768e635-9189-4483-9b22-e0af7c87b523" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb435903-cf27-4265-a9c4-14acf66a5b03]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack sudo[114933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:57 devstack sudo[114933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack sudo[114929]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.info" returned: 0 in 0.269s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.328s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:57 devstack sudo[114931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 Aug 26 03:18:57 devstack sudo[114931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Creating offline snapshot 0c6709b7-c28c-4919-9455-a366c9a4a974 of volume 0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:18:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e565c00d-783c-4d21-91b2-657f7ab5e2ff tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd51fb0-2ea3-416d-8ce6-c723e3e884d8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-debfc505-9e32-48d0-85ca-fe1e7ab7f0ac-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-debfc505-9e32-48d0-85ca-fe1e7ab7f0ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-4455a4a4-463d-4bbb-9939-6920aa93dbb5" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-4455a4a4-463d-4bbb-9939-6920aa93dbb5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleting offline snapshot debfc505-9e32-48d0-85ca-fe1e7ab7f0ac of volume 4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] snapshot_file for this snap is: volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[860ae8e4-b37a-4f29-93aa-7c334a3b8dd7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:57 devstack sudo[114936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 Aug 26 03:18:57 devstack sudo[114936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:57 devstack sudo[114933]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:57 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleted volume successfully. Aug 26 03:18:57 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5c930da9-3c53-4708-98c6-4e9bc9398635 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-e84ca8d3-5127-46ed-a53d-793ac13f22f2-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:58 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac Aug 26 03:18:58 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack sudo[114931]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523" returned: 0 in 0.571s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523 Aug 26 03:18:58 devstack sudo[114945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack sudo[114936]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17" returned: 0 in 0.446s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 1G Aug 26 03:18:58 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e3196-4ac7-43b5-a6f7-6e35edbf6fda]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114945]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-e768e635-9189-4483-9b22-e0af7c87b523" returned: 0 in 0.286s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-e768e635-9189-4483-9b22-e0af7c87b523" released by "delete_volume" :: held 0.935s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:58 devstack sudo[114955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 Aug 26 03:18:58 devstack sudo[114955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Created reservations ['d8adfe28-0cc1-4fb8-90e1-6091e74b24df', '66e00609-09b3-4a31-9881-28566fd19d63', '12ae7451-583c-44cd-b65d-ee483be72062', '726eaa84-6e7f-476b-bbf0-212a2f09423a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:18:58 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-2c18dba2-88aa-46aa-8507-65a723160f1f-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-2c18dba2-88aa-46aa-8507-65a723160f1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-9616bf39-fb9d-4bb1-a690-610a126cdd16" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:58 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 1G" returned: 0 in 0.529s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0744dd86-038b-4ea8-a299-013db6b86f17 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-9616bf39-fb9d-4bb1-a690-610a126cdd16" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-2c18dba2-88aa-46aa-8507-65a723160f1f" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:58 devstack sudo[114965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0744dd86-038b-4ea8-a299-013db6b86f17 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 Aug 26 03:18:58 devstack sudo[114965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-2c18dba2-88aa-46aa-8507-65a723160f1f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 2c18dba2-88aa-46aa-8507-65a723160f1f of volume 9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:18:58 devstack sudo[114955]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a84c10-a12c-4144-9bd4-fef09a060af1]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5" returned: 0 in 0.469s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:58 devstack sudo[114970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac Aug 26 03:18:58 devstack sudo[114970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:58 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.318s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:18:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Deleted volume successfully. Aug 26 03:18:58 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3d98d71a-c5b9-44d2-b9d4-217755ff7f8b tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-e768e635-9189-4483-9b22-e0af7c87b523-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:58 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f Aug 26 03:18:58 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack sudo[114965]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0744dd86-038b-4ea8-a299-013db6b86f17 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974" returned: 0 in 0.381s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 is being set with open permissions: ugo+rw Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 Aug 26 03:18:59 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack sudo[114970]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" returned: 0 in 0.368s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac Aug 26 03:18:59 devstack sudo[114985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9616bf39-fb9d-4bb1-a690-610a126cdd16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd6fcd0-c22c-4c64-878f-3361df85d2de]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974" returned: 0 in 0.272s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack sudo[114987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 Aug 26 03:18:59 devstack sudo[114987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info Aug 26 03:18:59 devstack sudo[114991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack sudo[114985]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5.debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-debfc505-9e32-48d0-85ca-fe1e7ab7f0ac" released by "_delete_snapshot" :: held 1.676s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-4455a4a4-463d-4bbb-9939-6920aa93dbb5" released by "delete_snapshot" :: held 1.713s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['65b59a36-238a-43a6-8f8c-8da139a40b77', '61a582bd-c566-4370-a876-0a818be1da00', 'd36c97d8-0d47-4b17-af56-2412387dcc29', '230c6591-576d-4a22-8fdb-b2ede23dbee8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-de5fa165-6661-44fc-b39f-874ec7000330-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-de5fa165-6661-44fc-b39f-874ec7000330-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:59 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Delete snapshot completed successfully. Aug 26 03:18:59 devstack sudo[114987]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16" returned: 0 in 0.439s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fea9e026-9adf-4521-8a22-29b6f087ecb2 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-debfc505-9e32-48d0-85ca-fe1e7ab7f0ac-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:18:59 devstack sudo[114991]: pam_unix(sudo:session): session closed for user root Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info" returned: 0 in 0.325s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:18:59 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info is being set with open permissions: ugo+rw Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[114997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f Aug 26 03:18:59 devstack sudo[114997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "cinder-quobyte-de5fa165-6661-44fc-b39f-874ec7000330" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:18:59 devstack sudo[114998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info Aug 26 03:18:59 devstack sudo[114998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-de5fa165-6661-44fc-b39f-874ec7000330" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e2cdd-a802-48c5-a9d5-d3f5e955078e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:18:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:18:59 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 Aug 26 03:18:59 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[114998]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.info" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.325s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-4455a4a4-463d-4bbb-9939-6920aa93dbb5-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-4455a4a4-463d-4bbb-9939-6920aa93dbb5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f53a7cb6-e4bb-40b0-90b8-c6ce1c080665 tempest-ProjectReaderTests-1767369721 None] Create snapshot completed successfully Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "cinder-quobyte-4455a4a4-463d-4bbb-9939-6920aa93dbb5" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-4455a4a4-463d-4bbb-9939-6920aa93dbb5" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:00 devstack sudo[114997]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f" returned: 0 in 0.432s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b179b-dd65-41aa-931d-94e3dae69b79]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack sudo[115008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f Aug 26 03:19:00 devstack sudo[115008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330" returned: 0 in 0.443s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack sudo[115014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330 Aug 26 03:19:00 devstack sudo[115014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[115011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 Aug 26 03:19:00 devstack sudo[115011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack sudo[115008]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16.2c18dba2-88aa-46aa-8507-65a723160f1f" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-2c18dba2-88aa-46aa-8507-65a723160f1f" released by "_delete_snapshot" :: held 1.672s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-9616bf39-fb9d-4bb1-a690-610a126cdd16" released by "delete_snapshot" :: held 1.709s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:00 devstack sudo[115014]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-de5fa165-6661-44fc-b39f-874ec7000330" returned: 0 in 0.253s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-quobyte-de5fa165-6661-44fc-b39f-874ec7000330" released by "delete_volume" :: held 0.738s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Created reservations ['c037de05-b284-41c9-a0cc-eb4494517fd6', '6e153d54-cdf4-473c-a9d1-5f7d1973b679', 'd8a1ea59-e851-4c3b-9ed4-60433971c692', 'f20e06a7-d07a-4c5b-991b-b530ba33f253'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:00 devstack sudo[115011]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5" returned: 0 in 0.413s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack sudo[115022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5 Aug 26 03:19:00 devstack sudo[115022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Created reservations ['5929992e-52f0-409f-8659-3d939dede21e', '2497b9e0-ab3a-4a7a-886c-1147584531b9', 'ff021568-cc56-4c64-830a-a75221de640c', '8cbe2e0d-8d51-42c5-9db5-261f5ae1285a'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f8c4164c-b25c-4ee1-b79d-72da22b99512 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-2c18dba2-88aa-46aa-8507-65a723160f1f-delete_snapshot" released by "delete_snapshot" :: held 1.944s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:00 devstack sudo[115024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:00 devstack sudo[115024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-0c6709b7-c28c-4919-9455-a366c9a4a974-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-0c6709b7-c28c-4919-9455-a366c9a4a974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-0744dd86-038b-4ea8-a299-013db6b86f17" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-0744dd86-038b-4ea8-a299-013db6b86f17" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-0c6709b7-c28c-4919-9455-a366c9a4a974" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-0c6709b7-c28c-4919-9455-a366c9a4a974" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Deleting offline snapshot 0c6709b7-c28c-4919-9455-a366c9a4a974 of volume 0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] snapshot_file for this snap is: volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[79809d82-3086-48e9-82d5-ea52ec147f54]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack sudo[115022]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-4455a4a4-463d-4bbb-9939-6920aa93dbb5" returned: 0 in 0.392s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:01 devstack sudo[115026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 Aug 26 03:19:01 devstack sudo[115026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-9616bf39-fb9d-4bb1-a690-610a126cdd16-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:01 devstack sudo[115024]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-quobyte-4455a4a4-463d-4bbb-9939-6920aa93dbb5" released by "delete_volume" :: held 1.014s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Deleted volume successfully. Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-9616bf39-fb9d-4bb1-a690-610a126cdd16-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-3c50f83b-46cf-44e1-b744-61205ad33b65 tempest-VolumeDependencyTests-1871356646 None] Lock "cinder-de5fa165-6661-44fc-b39f-874ec7000330-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-9616bf39-fb9d-4bb1-a690-610a126cdd16" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Created reservations ['49725a3c-e22c-4c00-a5a6-23d35fb8974c', '6ed91834-b8f6-4c6d-9c77-99119fd43405', 'e81a3ee5-2b7d-40b3-8300-62b4126c2aeb', '8f84a1f2-197d-4ffa-811d-de1f7d81d4f7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-9616bf39-fb9d-4bb1-a690-610a126cdd16" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b758fd0-416f-4297-bfc6-d2399db17a0a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack sudo[115026]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974" returned: 0 in 0.548s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0744dd86-038b-4ea8-a299-013db6b86f17(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:01 devstack sudo[115034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:01 devstack sudo[115034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:01 devstack sudo[115031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 Aug 26 03:19:01 devstack sudo[115031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2375086d-09ba-4623-8ed6-ff724d7fae51]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack sudo[115037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 Aug 26 03:19:01 devstack sudo[115037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:01 devstack sudo[115034]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.307s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:01 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Deleted volume successfully. Aug 26 03:19:01 devstack sudo[115031]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5539ff38-6f30-4190-b728-09485c30e2d7 tempest-CreateVolumesFromSnapshotTest-846708255 None] Lock "cinder-4455a4a4-463d-4bbb-9939-6920aa93dbb5-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:01 devstack sudo[115043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16 Aug 26 03:19:01 devstack sudo[115043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:01 devstack sudo[115037]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17" returned: 0 in 0.426s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:01 devstack sudo[115048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 Aug 26 03:19:01 devstack sudo[115048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack sudo[115043]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-9616bf39-fb9d-4bb1-a690-610a126cdd16" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-9616bf39-fb9d-4bb1-a690-610a126cdd16" released by "delete_volume" :: held 0.772s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Created reservations ['1cb33118-2526-4f5a-a7c4-b90ef11fe5f1', '07bc9205-ba5c-4432-ab19-2bf4834f73f3', '4ad2005f-cee7-4667-86fa-b3657ece8891', '92d51a7d-5314-47c0-a698-3ba2a9e8ce1c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:02 devstack sudo[115055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:02 devstack sudo[115055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack sudo[115048]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974" returned: 0 in 0.471s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:02 devstack sudo[115057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974 Aug 26 03:19:02 devstack sudo[115057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:02 devstack sudo[115055]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-067a944c-42c1-4f19-8b4b-c7f78a323807 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-9616bf39-fb9d-4bb1-a690-610a126cdd16-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:02 devstack sudo[115057]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17.0c6709b7-c28c-4919-9455-a366c9a4a974" returned: 0 in 0.284s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-0c6709b7-c28c-4919-9455-a366c9a4a974" released by "_delete_snapshot" :: held 1.860s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-0744dd86-038b-4ea8-a299-013db6b86f17" released by "delete_snapshot" :: held 1.887s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Created reservations ['a5337d3b-9506-463f-b8a4-d0ab3e799730', '85ddbe4b-981e-4150-8a0d-0e01cbe0b2b1', '793dc773-347b-4e83-b379-7423b275ee13', '10c23faa-a5de-47f2-8808-a17ec34b3084'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Delete snapshot completed successfully. Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b20fa17b-c859-4529-8325-3a507dbc8138 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-0c6709b7-c28c-4919-9455-a366c9a4a974-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-0744dd86-038b-4ea8-a299-013db6b86f17-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-0744dd86-038b-4ea8-a299-013db6b86f17-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-0744dd86-038b-4ea8-a299-013db6b86f17" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-0744dd86-038b-4ea8-a299-013db6b86f17" acquired by "delete_volume" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fc1338-51e0-4aed-9718-66594b198c1b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:03 devstack sudo[115061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 Aug 26 03:19:03 devstack sudo[115061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:03 devstack sudo[115061]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17" returned: 0 in 0.461s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:03 devstack sudo[115067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17 Aug 26 03:19:03 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (a7ce58f8-b686-41b4-99ee-cd9a753ed165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cde8bff-2696-46af-8757-44844a3f7516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cde8bff-2696-46af-8757-44844a3f7516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404551307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:04Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be73eccc-0a4f-4042-aa87-deeb282ef876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be73eccc-0a4f-4042-aa87-deeb282ef876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee5ec20-93b2-4685-be9b-65eecfeeb94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:03 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ee5ec20-93b2-4685-be9b-65eecfeeb94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a', 'volume_name': 'volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765e02a0-95bc-4be8-a5a0-09023f7e0f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (765e02a0-95bc-4be8-a5a0-09023f7e0f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a94825-41cc-433c-a077-78029d451087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:03 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Volume 0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a', 'volume_size': 1} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404551307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:04Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Creating volume 0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:03 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0744dd86-038b-4ea8-a299-013db6b86f17" returned: 0 in 0.379s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:03 devstack sudo[115070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a 1073741824 Aug 26 03:19:03 devstack sudo[115070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:03 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-0744dd86-038b-4ea8-a299-013db6b86f17" released by "delete_volume" :: held 0.934s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Created reservations ['88ea029e-7a9e-42d0-a5d6-affa0517bc3d', '9edb3e30-275d-48f3-a334-97fbfc863470', '0de9e880-2a0c-4be7-a74b-a119688ef6e3', 'fca4e490-ca52-47d3-aecf-14fa94818a80'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:04 devstack sudo[115074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:04 devstack sudo[115074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:04 devstack sudo[115074]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.295s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:04 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Deleted volume successfully. Aug 26 03:19:04 devstack sudo[115070]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-84b8c1a3-2c51-4465-873f-000665dbaf19 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-0744dd86-038b-4ea8-a299-013db6b86f17-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a 1073741824" returned: 0 in 0.638s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:04 devstack sudo[115079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a Aug 26 03:19:04 devstack sudo[115079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:04 devstack sudo[115079]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (4ebf95ca-d2c0-4a4a-9e6c-bfed94ddbadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32947ac-7ffe-48f2-894c-5129bd5a4d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" returned: 0 in 0.350s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32947ac-7ffe-48f2-894c-5129bd5a4d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901024785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5ff28d-4961-41bf-8beb-fdafc95a6699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:05Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae5e215-78e7-4955-8864-316305f1a69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae5e215-78e7-4955-8864-316305f1a69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bf59dd-7ab7-4d2c-b995-28185c36d98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bf59dd-7ab7-4d2c-b995-28185c36d98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a5ff28d-4961-41bf-8beb-fdafc95a6699', 'volume_name': 'volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a51e1d-6a92-4fd0-93bd-d5c6d623453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a51e1d-6a92-4fd0-93bd-d5c6d623453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884f7539-d85d-429c-bcd7-c35c5f9d9750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Volume 6a5ff28d-4961-41bf-8beb-fdafc95a6699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699', 'volume_size': 1} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1901024785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a5ff28d-4961-41bf-8beb-fdafc95a6699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:05Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Creating volume 6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:05 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a94825-41cc-433c-a077-78029d451087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907ebe6c-9a0f-4b49-97f6-bc0d4d513bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:05 devstack sudo[115082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 1073741824 Aug 26 03:19:05 devstack sudo[115082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Volume volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a (0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a): created successfully Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907ebe6c-9a0f-4b49-97f6-bc0d4d513bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (a7ce58f8-b686-41b4-99ee-cd9a753ed165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-34282e8b-f28d-478f-8641-2c318b862a57 tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:19:05 devstack sudo[115082]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 1073741824" returned: 0 in 0.507s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:05 devstack sudo[115088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 Aug 26 03:19:05 devstack sudo[115088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:05 devstack sudo[115088]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699" returned: 0 in 0.282s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884f7539-d85d-429c-bcd7-c35c5f9d9750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba32531-e23a-4c70-bc30-456c473c3fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:05 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Volume volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 (6a5ff28d-4961-41bf-8beb-fdafc95a6699): created successfully Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba32531-e23a-4c70-bc30-456c473c3fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:05 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (4ebf95ca-d2c0-4a4a-9e6c-bfed94ddbadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:05 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-df95a5d2-3a5e-4786-be1d-3cef5842acad tempest-ProjectReaderTests-1767369721 None] Created volume successfully. Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot df0a83cb-5d09-4b4c-9878-1f321e03ecba of volume 0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (4b48756a-80fc-4f56-b335-52fc948798ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e412918d-aa98-4d36-97ed-e52a931a97a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52e915-0bd0-482d-91cf-534e6b59bcbc]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e412918d-aa98-4d36-97ed-e52a931a97a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656640721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c709c308-3817-44e4-9219-da94c6544003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:06Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71602fe-4338-4e5f-890f-c1f646baae6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71602fe-4338-4e5f-890f-c1f646baae6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5d7587-7c98-44a9-99d0-13d292083341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5d7587-7c98-44a9-99d0-13d292083341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c709c308-3817-44e4-9219-da94c6544003', 'volume_name': 'volume-c709c308-3817-44e4-9219-da94c6544003', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4871d1b7-e7da-48a7-ab38-cdc55a8f1a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4871d1b7-e7da-48a7-ab38-cdc55a8f1a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fabc5a8-992f-4bb1-99b1-17887a92de19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:06 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume c709c308-3817-44e4-9219-da94c6544003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c709c308-3817-44e4-9219-da94c6544003', 'volume_size': 1} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:06 devstack sudo[115091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a Aug 26 03:19:06 devstack sudo[115091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:06 devstack sudo[115091]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" returned: 0 in 0.357s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:06 devstack sudo[115096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba 1G Aug 26 03:19:06 devstack sudo[115096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack sudo[115096]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba 1G" returned: 0 in 0.510s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:07 devstack sudo[115102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba Aug 26 03:19:07 devstack sudo[115102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:07 devstack sudo[115102]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba" returned: 0 in 0.297s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:07 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba is being set with open permissions: ugo+rw Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:07 devstack sudo[115108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba Aug 26 03:19:07 devstack sudo[115108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:07 devstack sudo[115108]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:07 devstack sudo[115111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info Aug 26 03:19:07 devstack sudo[115111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:08 devstack sudo[115111]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info" returned: 0 in 0.286s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:08 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info is being set with open permissions: ugo+rw Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:08 devstack sudo[115114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info Aug 26 03:19:08 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:08 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.info" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.958s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-656640721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c709c308-3817-44e4-9219-da94c6544003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:06Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Creating volume c709c308-3817-44e4-9219-da94c6544003 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:08 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:08 devstack sudo[115117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 1073741824 Aug 26 03:19:08 devstack sudo[115117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:08 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2cee4138-57dd-4ff7-86ba-b26276ae99e1 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:19:08 devstack sudo[115117]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 1073741824" returned: 0 in 0.407s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:08 devstack sudo[115123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 Aug 26 03:19:08 devstack sudo[115123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:09 devstack sudo[115123]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003" returned: 0 in 0.239s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.808s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fabc5a8-992f-4bb1-99b1-17887a92de19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c709c308-3817-44e4-9219-da94c6544003', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecbf878-c2db-4601-aceb-6cbded305b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Creating offline snapshot 2a4c6465-2dab-4482-be47-ca464222d42e of volume 6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:09 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume volume-c709c308-3817-44e4-9219-da94c6544003 (c709c308-3817-44e4-9219-da94c6544003): created successfully Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ecbf878-c2db-4601-aceb-6cbded305b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (4b48756a-80fc-4f56-b335-52fc948798ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[921a7d22-92fe-4439-93d3-ab6bae51db44]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:09 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-df244540-2495-4f09-9774-9d30c0ae45d1 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created volume successfully. Aug 26 03:19:09 devstack sudo[115126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 Aug 26 03:19:09 devstack sudo[115126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-df0a83cb-5d09-4b4c-9878-1f321e03ecba-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-df0a83cb-5d09-4b4c-9878-1f321e03ecba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-df0a83cb-5d09-4b4c-9878-1f321e03ecba" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-df0a83cb-5d09-4b4c-9878-1f321e03ecba" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot df0a83cb-5d09-4b4c-9878-1f321e03ecba of volume 0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3043bad9-0996-45eb-8fbb-b4642210f941]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:09 devstack sudo[115126]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699" returned: 0 in 0.432s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:09 devstack sudo[115132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e 1G Aug 26 03:19:09 devstack sudo[115132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:09 devstack sudo[115131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba Aug 26 03:19:09 devstack sudo[115131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:09 devstack sudo[115131]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba" returned: 0 in 0.438s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:09 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (0a7c70e2-dea9-4895-a85b-8b2592db9877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74e84f8-ac5b-4512-a1a6-2f6fcd3eb4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c19df0d-3868-4ca4-8f18-4218f644b21c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74e84f8-ac5b-4512-a1a6-2f6fcd3eb4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2089755842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0259f7-579d-4f7a-b26f-546392d8648d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:10Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6115ca53-cb22-4b07-b6b9-b47690cd2631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6115ca53-cb22-4b07-b6b9-b47690cd2631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8f61b3-d463-4360-a858-44e3949a1962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd8f61b3-d463-4360-a858-44e3949a1962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0259f7-579d-4f7a-b26f-546392d8648d', 'volume_name': 'volume-ca0259f7-579d-4f7a-b26f-546392d8648d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39dbce0-51bd-43f5-af56-752ca084cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39dbce0-51bd-43f5-af56-752ca084cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de911d5d-155a-402b-8fe5-05c0ddcce043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume ca0259f7-579d-4f7a-b26f-546392d8648d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0259f7-579d-4f7a-b26f-546392d8648d', 'volume_size': 1} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:10 devstack sudo[115142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a Aug 26 03:19:10 devstack sudo[115142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[115132]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e 1G" returned: 0 in 0.660s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[115144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e Aug 26 03:19:10 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[115142]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" returned: 0 in 0.485s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[115152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba Aug 26 03:19:10 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e" returned: 0 in 0.373s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e is being set with open permissions: ugo+rw Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[115154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e Aug 26 03:19:10 devstack sudo[115154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (caf42867-56f2-4d4d-8962-16201a3c70a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3220d034-29c8-41ff-a2a6-5f6596edf327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3220d034-29c8-41ff-a2a6-5f6596edf327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36553052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bba0e9-64cb-48fc-9446-d9a0131b177d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:11Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e46f86d-2176-4b80-9a88-b3ffdd5c0183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e46f86d-2176-4b80-9a88-b3ffdd5c0183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aa42d2-f39b-46aa-b72b-64fd0532fed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48aa42d2-f39b-46aa-b72b-64fd0532fed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09bba0e9-64cb-48fc-9446-d9a0131b177d', 'volume_name': 'volume-09bba0e9-64cb-48fc-9446-d9a0131b177d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d306cbb2-12db-4a61-a785-f40007378a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d306cbb2-12db-4a61-a785-f40007378a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:10 devstack sudo[115154]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ed673e-6b5c-4ac7-91aa-ac627b525f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:10 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume 09bba0e9-64cb-48fc-9446-d9a0131b177d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09bba0e9-64cb-48fc-9446-d9a0131b177d', 'volume_size': 1} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e" returned: 0 in 0.298s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:10 devstack sudo[115161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info Aug 26 03:19:10 devstack sudo[115161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:11 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (e9c63a9b-dabb-4e8b-82e9-2d45da629194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4eb7917-a158-435e-a1a8-b84d3894009e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4eb7917-a158-435e-a1a8-b84d3894009e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858249253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15889bf1-e841-428e-bf41-b065f8f3c66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:11Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f1e158-5997-42ed-8bea-6b5857815f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f1e158-5997-42ed-8bea-6b5857815f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085db64f-c81a-426d-9d47-cf2d5bd5ae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack sudo[115163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba Aug 26 03:19:11 devstack sudo[115163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085db64f-c81a-426d-9d47-cf2d5bd5ae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15889bf1-e841-428e-bf41-b065f8f3c66e', 'volume_name': 'volume-15889bf1-e841-428e-bf41-b065f8f3c66e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cb8376-9ebe-4471-af81-3efcfc058adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cb8376-9ebe-4471-af81-3efcfc058adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815a1cac-9abf-4e07-b04e-dba44b8c4567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume 15889bf1-e841-428e-bf41-b065f8f3c66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15889bf1-e841-428e-bf41-b065f8f3c66e', 'volume_size': 1} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:11 devstack sudo[115161]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info" returned: 0 in 0.395s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info is being set with open permissions: ugo+rw Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:11 devstack sudo[115166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info Aug 26 03:19:11 devstack sudo[115166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (1341a9f2-62b9-4826-a78f-115644ab338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5274f0f8-5d40-4d49-8a1b-5e467efaca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5274f0f8-5d40-4d49-8a1b-5e467efaca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640343859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81dea91-dfdb-484f-9812-2a915167aa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:11Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa59628-8d5f-4e1b-8a86-5fcaebc19d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa59628-8d5f-4e1b-8a86-5fcaebc19d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3805be17-fff3-4643-90c0-4cce539bca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3805be17-fff3-4643-90c0-4cce539bca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c81dea91-dfdb-484f-9812-2a915167aa30', 'volume_name': 'volume-c81dea91-dfdb-484f-9812-2a915167aa30', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f586c8-9674-4b9a-8882-cc5ecc6737c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f586c8-9674-4b9a-8882-cc5ecc6737c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dfdbc0-0ba3-41b2-a06e-7a52772df785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume c81dea91-dfdb-484f-9812-2a915167aa30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c81dea91-dfdb-484f-9812-2a915167aa30', 'volume_size': 1} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:11 devstack sudo[115163]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a.df0a83cb-5d09-4b4c-9878-1f321e03ecba" returned: 0 in 0.412s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-df0a83cb-5d09-4b4c-9878-1f321e03ecba" released by "_delete_snapshot" :: held 2.074s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" released by "delete_snapshot" :: held 2.110s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Created reservations ['c5eb0307-65dc-40d4-b846-b708b1f859de', '882b62d0-ae1a-45d4-b64f-0c3cfe368138', 'ff4ac3e7-481b-45d3-b9e8-cfe110a6609a', '6e3f9490-14f9-4c2d-a958-95c8f52c6bcb'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:11 devstack sudo[115166]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.info" returned: 0 in 0.330s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2089755842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0259f7-579d-4f7a-b26f-546392d8648d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:10Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Creating volume ca0259f7-579d-4f7a-b26f-546392d8648d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:11 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:11 devstack sudo[115170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d 1073741824 Aug 26 03:19:11 devstack sudo[115170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4d2f7ee3-2080-44b5-804b-7bd5bc3853b2 tempest-ProjectReaderTests-1767369721 None] Create snapshot completed successfully Aug 26 03:19:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-17480892-53d8-4ce0-97c6-30382e348412 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-df0a83cb-5d09-4b4c-9878-1f321e03ecba-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (e431ce36-5259-4a57-bcee-a276c26e3054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6aac7b4-2fcd-43b7-a0bd-b43fb92da9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6aac7b4-2fcd-43b7-a0bd-b43fb92da9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827742256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5345c654-e346-465f-b5cb-f4b3ecfafbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:12Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15e0158-cc44-4829-bd75-9200838668af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e15e0158-cc44-4829-bd75-9200838668af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de695cac-63d4-4893-8cd7-d668e15104e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de695cac-63d4-4893-8cd7-d668e15104e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5345c654-e346-465f-b5cb-f4b3ecfafbe6', 'volume_name': 'volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2360d36-425c-4d22-8dc8-d7be5928b05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2360d36-425c-4d22-8dc8-d7be5928b05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935003d0-215b-4674-a7ad-2b59fd2403ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:11 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume 5345c654-e346-465f-b5cb-f4b3ecfafbe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6', 'volume_size': 1} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf288d-4852-4d54-8cc2-3798ecf58a56]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack sudo[115175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a Aug 26 03:19:12 devstack sudo[115175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[115170]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d 1073741824" returned: 0 in 0.518s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack sudo[115178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d Aug 26 03:19:12 devstack sudo[115178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[115175]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" returned: 0 in 0.381s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack sudo[115183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a Aug 26 03:19:12 devstack sudo[115183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack sudo[115178]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d" returned: 0 in 0.279s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.659s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-36553052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09bba0e9-64cb-48fc-9446-d9a0131b177d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:11Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Creating volume 09bba0e9-64cb-48fc-9446-d9a0131b177d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:12 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-2a4c6465-2dab-4482-be47-ca464222d42e-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:12 devstack sudo[115186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d 1073741824 Aug 26 03:19:12 devstack sudo[115186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de911d5d-155a-402b-8fe5-05c0ddcce043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0259f7-579d-4f7a-b26f-546392d8648d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77af99ab-917f-4a82-b468-6ced52fb930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:12 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume volume-ca0259f7-579d-4f7a-b26f-546392d8648d (ca0259f7-579d-4f7a-b26f-546392d8648d): created successfully Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77af99ab-917f-4a82-b468-6ced52fb930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (0a7c70e2-dea9-4895-a85b-8b2592db9877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-2a4c6465-2dab-4482-be47-ca464222d42e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-6a5ff28d-4961-41bf-8beb-fdafc95a6699" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:12 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4c1fe4d2-22d9-4b70-aae0-94717a4a05db tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created volume successfully. Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-6a5ff28d-4961-41bf-8beb-fdafc95a6699" acquired by "delete_snapshot" :: waited 0.050s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-2a4c6465-2dab-4482-be47-ca464222d42e" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-2a4c6465-2dab-4482-be47-ca464222d42e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:12 devstack sudo[115183]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Deleting offline snapshot 2a4c6465-2dab-4482-be47-ca464222d42e of volume 6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] snapshot_file for this snap is: volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" returned: 0 in 0.402s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4460a2-4246-46f9-800a-d4dcbceda2de]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a" released by "delete_volume" :: held 0.870s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:12 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Created reservations ['e22834cb-e42d-4e4f-8d25-9b2ee7fedda4', '5932adb4-b3bc-4940-a8dc-18ed63c2ba3c', '134941d1-0e5a-4571-9b26-77ca3d8c28b6', 'd7cafc61-bd46-423f-93ce-7f3b49e5e381'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:12 devstack sudo[115189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e Aug 26 03:19:12 devstack sudo[115189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack sudo[115194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:13 devstack sudo[115194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:13 devstack sudo[115186]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d 1073741824" returned: 0 in 0.577s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack sudo[115198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d Aug 26 03:19:13 devstack sudo[115198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:13 devstack sudo[115189]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e" returned: 0 in 0.444s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaaec47-93de-4d9e-8066-96c38e2d5da5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack sudo[115194]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.320s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:13 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0ee62010-4297-43cf-abce-ad74427f74e8 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-0fd5feb0-b8b7-4304-9ff1-b646d5e94f9a-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:13 devstack sudo[115203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 Aug 26 03:19:13 devstack sudo[115203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:13 devstack sudo[115198]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-858249253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15889bf1-e841-428e-bf41-b065f8f3c66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:11Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Creating volume 15889bf1-e841-428e-bf41-b065f8f3c66e {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:13 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ed673e-6b5c-4ac7-91aa-ac627b525f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09bba0e9-64cb-48fc-9446-d9a0131b177d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:13 devstack sudo[115207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e 1073741824 Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbf6f67-5636-4436-a782-25716ac3c2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:13 devstack sudo[115207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:13 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume volume-09bba0e9-64cb-48fc-9446-d9a0131b177d (09bba0e9-64cb-48fc-9446-d9a0131b177d): created successfully Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbf6f67-5636-4436-a782-25716ac3c2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (caf42867-56f2-4d4d-8962-16201a3c70a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:13 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-479791e1-8d9d-4e38-b457-6b693e51862c tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created volume successfully. Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (d3da98cf-6833-40ec-af42-1dad50d3a48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fb92f1-f74f-428b-a724-9da6dbf21a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78fb92f1-f74f-428b-a724-9da6dbf21a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954737370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3346231f-629f-4d5f-b418-c913c8e32282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:14Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b7c125-f016-40cd-b9df-3c26077bc6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b7c125-f016-40cd-b9df-3c26077bc6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2007c166-ae6a-4219-9a25-3a6b82ce4e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2007c166-ae6a-4219-9a25-3a6b82ce4e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3346231f-629f-4d5f-b418-c913c8e32282', 'volume_name': 'volume-3346231f-629f-4d5f-b418-c913c8e32282', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fa5592-8d5d-4ef9-86d9-927e2e7934e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65fa5592-8d5d-4ef9-86d9-927e2e7934e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f73cf5e-e9d9-4410-953b-81a990e6c8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:13 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Volume 3346231f-629f-4d5f-b418-c913c8e32282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3346231f-629f-4d5f-b418-c913c8e32282', 'volume_size': 1} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:13 devstack sudo[115203]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699" returned: 0 in 0.449s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:13 devstack sudo[115214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e Aug 26 03:19:13 devstack sudo[115214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack sudo[115207]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e 1073741824" returned: 0 in 0.528s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[115222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e Aug 26 03:19:14 devstack sudo[115222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack sudo[115214]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e" returned: 0 in 0.415s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[115224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e Aug 26 03:19:14 devstack sudo[115224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack sudo[115222]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.928s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-640343859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c81dea91-dfdb-484f-9812-2a915167aa30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:11Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Creating volume c81dea91-dfdb-484f-9812-2a915167aa30 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:14 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815a1cac-9abf-4e07-b04e-dba44b8c4567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15889bf1-e841-428e-bf41-b065f8f3c66e', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd332ad-d938-4d01-9a0f-da0bc729843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:14 devstack sudo[115227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 1073741824 Aug 26 03:19:14 devstack sudo[115227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume volume-15889bf1-e841-428e-bf41-b065f8f3c66e (15889bf1-e841-428e-bf41-b065f8f3c66e): created successfully Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfd332ad-d938-4d01-9a0f-da0bc729843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (e9c63a9b-dabb-4e8b-82e9-2d45da629194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ef603de5-d634-4127-aaaf-788c8b2189f2 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created volume successfully. Aug 26 03:19:14 devstack sudo[115224]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699.2a4c6465-2dab-4482-be47-ca464222d42e" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-2a4c6465-2dab-4482-be47-ca464222d42e" released by "_delete_snapshot" :: held 1.738s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-6a5ff28d-4961-41bf-8beb-fdafc95a6699" released by "delete_snapshot" :: held 1.774s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Created reservations ['f96fdf19-acd2-41e2-bd4a-a4b6102bf78b', '708698a4-e0f8-4c4a-b195-8b9017fe9fd1', 'fb796c97-b12f-4eda-9ae5-3b77feabb458', '09e833ca-155e-4792-9fbe-01f6491ac0b2'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Delete snapshot completed successfully. Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-c1a58ba1-90ca-4b0b-9ca6-13a9e150b706 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-2a4c6465-2dab-4482-be47-ca464222d42e-delete_snapshot" released by "delete_snapshot" :: held 1.981s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-6a5ff28d-4961-41bf-8beb-fdafc95a6699-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-6a5ff28d-4961-41bf-8beb-fdafc95a6699-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-6a5ff28d-4961-41bf-8beb-fdafc95a6699" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-6a5ff28d-4961-41bf-8beb-fdafc95a6699" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[743cad6a-4b90-4e57-87d7-40d92328dc25]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[115227]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 1073741824" returned: 0 in 0.526s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:14 devstack sudo[115236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 Aug 26 03:19:14 devstack sudo[115236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:14 devstack sudo[115235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 Aug 26 03:19:14 devstack sudo[115235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack sudo[115236]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30" returned: 0 in 0.258s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.275s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-827742256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5345c654-e346-465f-b5cb-f4b3ecfafbe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2317637ae315421c8b453c5cb5298137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:12Z,use_quota=True,user_id='47d152eceb63450f86234dd2cd70f114',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Creating volume 5345c654-e346-465f-b5cb-f4b3ecfafbe6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:15 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:15 devstack sudo[115242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 1073741824 Aug 26 03:19:15 devstack sudo[115242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dfdbc0-0ba3-41b2-a06e-7a52772df785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c81dea91-dfdb-484f-9812-2a915167aa30', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec486a55-a16d-40cb-8625-d0d5dd3faf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:15 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume volume-c81dea91-dfdb-484f-9812-2a915167aa30 (c81dea91-dfdb-484f-9812-2a915167aa30): created successfully Aug 26 03:19:15 devstack sudo[115235]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec486a55-a16d-40cb-8625-d0d5dd3faf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (1341a9f2-62b9-4826-a78f-115644ab338c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699" returned: 0 in 0.411s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:15 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9b169934-7d7b-4d50-9944-150568930717 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created volume successfully. Aug 26 03:19:15 devstack sudo[115245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699 Aug 26 03:19:15 devstack sudo[115245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack sudo[115245]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-6a5ff28d-4961-41bf-8beb-fdafc95a6699" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-6a5ff28d-4961-41bf-8beb-fdafc95a6699" released by "delete_volume" :: held 0.719s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Created reservations ['67a9f7ea-ab28-4116-9687-48703ec235b2', '93591440-b3e5-46e6-9b26-24fb5d503983', '65787578-6f29-44df-96e4-3929986be09f', '935f93bc-f5af-47e8-8c93-86deaa53e4b8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:15 devstack sudo[115242]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 1073741824" returned: 0 in 0.464s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:15 devstack sudo[115252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:15 devstack sudo[115252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:15 devstack sudo[115254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 Aug 26 03:19:15 devstack sudo[115254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:15 devstack sudo[115252]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.257s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:15 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:15 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Deleted volume successfully. Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-b9ae1e4d-d2f6-4ddf-899f-32d5e18be143 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-6a5ff28d-4961-41bf-8beb-fdafc95a6699-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:16 devstack sudo[115254]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6" returned: 0 in 0.291s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.324s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1954737370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3346231f-629f-4d5f-b418-c913c8e32282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:14Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Creating volume 3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:16 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (935003d0-215b-4674-a7ad-2b59fd2403ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:16 devstack sudo[115258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 1073741824 Aug 26 03:19:16 devstack sudo[115258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126a1dbd-2228-40d6-832c-dbfa359c673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Volume volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 (5345c654-e346-465f-b5cb-f4b3ecfafbe6): created successfully Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126a1dbd-2228-40d6-832c-dbfa359c673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Flow 'volume_create_manager' (e431ce36-5259-4a57-bcee-a276c26e3054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5fe4814c-ae94-494a-ac97-9757ad95206e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created volume successfully. Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-5345c654-e346-465f-b5cb-f4b3ecfafbe6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-5345c654-e346-465f-b5cb-f4b3ecfafbe6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (3abd6e1a-4fe4-4143-9211-fb67e6b5908e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106bb632-7e05-4ab6-9d79-e5cdf1da60eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (106bb632-7e05-4ab6-9d79-e5cdf1da60eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160145300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67802d96-5d4e-49e1-82ef-cd23f5d05e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:16Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a8765e-d38b-4f41-ba09-4216e31458f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a8765e-d38b-4f41-ba09-4216e31458f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2761ed86-b854-441b-99df-aa6cd00e921f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:16 devstack sudo[115258]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2761ed86-b854-441b-99df-aa6cd00e921f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67802d96-5d4e-49e1-82ef-cd23f5d05e59', 'volume_name': 'volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff11acd5-b688-4161-8d5a-92c6f9a84a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff11acd5-b688-4161-8d5a-92c6f9a84a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a7ef54-2592-49b6-add5-e9c972664d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:16 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Volume 67802d96-5d4e-49e1-82ef-cd23f5d05e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59', 'volume_size': 1} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-quobyte-5345c654-e346-465f-b5cb-f4b3ecfafbe6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 1073741824" returned: 0 in 0.596s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-5345c654-e346-465f-b5cb-f4b3ecfafbe6" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9ec764-c3ec-46a8-8b97-27101e8e0d13]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:16 devstack sudo[115265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 Aug 26 03:19:16 devstack sudo[115265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:16 devstack sudo[115264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 Aug 26 03:19:16 devstack sudo[115264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:16 devstack sudo[115265]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282" returned: 0 in 0.263s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.342s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1160145300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67802d96-5d4e-49e1-82ef-cd23f5d05e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:16Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Creating volume 67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:16 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f73cf5e-e9d9-4410-953b-81a990e6c8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3346231f-629f-4d5f-b418-c913c8e32282', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:17 devstack sudo[115269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 1073741824 Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babb7a11-60b0-4109-8125-5d33973c557d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:17 devstack sudo[115269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Volume volume-3346231f-629f-4d5f-b418-c913c8e32282 (3346231f-629f-4d5f-b418-c913c8e32282): created successfully Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babb7a11-60b0-4109-8125-5d33973c557d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (d3da98cf-6833-40ec-af42-1dad50d3a48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ad418a3c-1382-4d54-bde4-912baa87332e tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:19:17 devstack sudo[115264]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6" returned: 0 in 0.418s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[115274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6 Aug 26 03:19:17 devstack sudo[115274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack sudo[115274]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-5345c654-e346-465f-b5cb-f4b3ecfafbe6" returned: 0 in 0.285s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-5345c654-e346-465f-b5cb-f4b3ecfafbe6" released by "delete_volume" :: held 0.759s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created reservations ['a52b5778-0952-403c-beba-77ea8c76917c', '70a798ec-2e94-4e63-ad56-e239ab710e5a', '3c122e4a-880c-4dd8-b880-695e59889b03', '51fd833c-c7b7-4e49-9059-50d51524ea30'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:17 devstack sudo[115269]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 1073741824" returned: 0 in 0.509s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[115283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 Aug 26 03:19:17 devstack sudo[115283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack sudo[115285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:17 devstack sudo[115285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-c81dea91-dfdb-484f-9812-2a915167aa30-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-c81dea91-dfdb-484f-9812-2a915167aa30-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-quobyte-c81dea91-dfdb-484f-9812-2a915167aa30" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-c81dea91-dfdb-484f-9812-2a915167aa30" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff89b42-c8a7-4d12-aa62-b68985a9e22c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:17 devstack sudo[115285]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.328s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:17 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Deleted volume successfully. Aug 26 03:19:17 devstack sudo[115283]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-30170e69-aaa0-4395-a751-d2d7edb8a7dc tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-5345c654-e346-465f-b5cb-f4b3ecfafbe6-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59" returned: 0 in 0.407s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:17 devstack sudo[115288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 Aug 26 03:19:17 devstack sudo[115288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a7ef54-2592-49b6-add5-e9c972664d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a9bc06-0a98-4290-9815-82ef57ce1233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:18 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Volume volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 (67802d96-5d4e-49e1-82ef-cd23f5d05e59): created successfully Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a9bc06-0a98-4290-9815-82ef57ce1233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (3abd6e1a-4fe4-4143-9211-fb67e6b5908e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:18 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5946300a-fb7f-4873-9bee-2ffba79bea98 tempest-ProjectReaderTests-1767369721 None] Created volume successfully. Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 1410960b-65c0-4b3b-becd-4c3526422479 of volume 3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e3c8cf-21b8-49ff-9d76-5d5d4c4a1c66]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[115288]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30" returned: 0 in 0.450s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[115291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 Aug 26 03:19:18 devstack sudo[115291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack sudo[115295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30 Aug 26 03:19:18 devstack sudo[115295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack sudo[115295]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c81dea91-dfdb-484f-9812-2a915167aa30" returned: 0 in 0.260s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack sudo[115291]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-c81dea91-dfdb-484f-9812-2a915167aa30" released by "delete_volume" :: held 0.765s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[115302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 1G Aug 26 03:19:18 devstack sudo[115302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created reservations ['dd0e3038-bff6-477a-a2a6-80eeca9836c9', '85520d8f-4801-414c-b8b8-6b5f581a5893', '94b5eafc-4a36-4b43-8031-9ff8384f744b', '3c8afffc-8b2c-441a-8794-ce6a42bc114c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:18 devstack sudo[115304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:18 devstack sudo[115304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-15889bf1-e841-428e-bf41-b065f8f3c66e-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-15889bf1-e841-428e-bf41-b065f8f3c66e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:18 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-quobyte-15889bf1-e841-428e-bf41-b065f8f3c66e" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-15889bf1-e841-428e-bf41-b065f8f3c66e" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[579b9818-e22b-4777-a08f-e2229572d254]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack sudo[115304]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.327s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:19 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Deleted volume successfully. Aug 26 03:19:19 devstack sudo[115302]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 1G" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3346231f-629f-4d5f-b418-c913c8e32282 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-55761503-7abf-4e66-b313-8ebf1ce002a5 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-c81dea91-dfdb-484f-9812-2a915167aa30-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:19 devstack sudo[115313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3346231f-629f-4d5f-b418-c913c8e32282 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 Aug 26 03:19:19 devstack sudo[115313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:19 devstack sudo[115311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e Aug 26 03:19:19 devstack sudo[115311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:19 devstack sudo[115311]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e" returned: 0 in 0.449s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:19 devstack sudo[115313]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3346231f-629f-4d5f-b418-c913c8e32282 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479" returned: 0 in 0.328s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:19 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 is being set with open permissions: ugo+rw Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack sudo[115322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e Aug 26 03:19:19 devstack sudo[115322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:19 devstack sudo[115323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 Aug 26 03:19:19 devstack sudo[115323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:19 devstack sudo[115323]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:19 devstack sudo[115322]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-15889bf1-e841-428e-bf41-b065f8f3c66e" returned: 0 in 0.272s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-15889bf1-e841-428e-bf41-b065f8f3c66e" released by "delete_volume" :: held 0.773s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack sudo[115328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info Aug 26 03:19:19 devstack sudo[115328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created reservations ['c3aca827-9e0f-4fdd-826c-abbe9040e44e', '7f7100be-5d49-49f9-bcc6-392adeee3bb2', '3fc6c8c6-4e95-465a-8e5e-d0e84c379273', '8c1dc310-71d1-4121-ab76-919cfc8e2847'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:19 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:19 devstack sudo[115336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:19 devstack sudo[115336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[115328]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info" returned: 0 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info is being set with open permissions: ugo+rw Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-09bba0e9-64cb-48fc-9446-d9a0131b177d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:20 devstack sudo[115339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info Aug 26 03:19:20 devstack sudo[115339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-09bba0e9-64cb-48fc-9446-d9a0131b177d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:20 devstack sudo[115336]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-quobyte-09bba0e9-64cb-48fc-9446-d9a0131b177d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:20 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Deleted volume successfully. Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-09bba0e9-64cb-48fc-9446-d9a0131b177d" acquired by "delete_volume" :: waited 0.032s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6de93366-9275-4e16-971c-631abadf580b tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-15889bf1-e841-428e-bf41-b065f8f3c66e-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[488b61a4-19ec-4e0c-9446-d037df1e0a49]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack sudo[115342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:20 devstack sudo[115342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[115339]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack sudo[115343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d Aug 26 03:19:20 devstack sudo[115343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.info" returned: 0 in 0.374s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.674s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Creating offline snapshot 5e1e4cf2-f445-414b-b5cd-116ea28156ed of volume 67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:20 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0f70330a-8df7-4ae1-8ac0-7e627d6105ec tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f748fcc4-dbbd-4c00-83d3-a39cea36a4bf]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack sudo[115342]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.310s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 28 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:19:20 devstack sudo[115347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 Aug 26 03:19:20 devstack sudo[115347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[115343]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d" returned: 0 in 0.487s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:20 devstack sudo[115353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d Aug 26 03:19:20 devstack sudo[115353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:20 devstack sudo[115347]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:21 devstack sudo[115358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed 1G Aug 26 03:19:21 devstack sudo[115358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:21 devstack sudo[115353]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-09bba0e9-64cb-48fc-9446-d9a0131b177d" returned: 0 in 0.272s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-09bba0e9-64cb-48fc-9446-d9a0131b177d" released by "delete_volume" :: held 0.843s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created reservations ['983eb0fb-25d2-486c-8145-d2340363a4b2', 'e36706ee-e594-48bb-957d-f5cb84db82f8', '32482654-d60f-4b8b-a6c5-45057b3a5968', 'a0026054-2f47-41a4-a819-71b4f170804e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-ca0259f7-579d-4f7a-b26f-546392d8648d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:21 devstack sudo[115364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:21 devstack sudo[115364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-ca0259f7-579d-4f7a-b26f-546392d8648d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-quobyte-ca0259f7-579d-4f7a-b26f-546392d8648d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-ca0259f7-579d-4f7a-b26f-546392d8648d" acquired by "delete_volume" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[43026b00-6eb0-46ee-a653-ad643afe3938]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-1410960b-65c0-4b3b-becd-4c3526422479-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-1410960b-65c0-4b3b-becd-4c3526422479-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-3346231f-629f-4d5f-b418-c913c8e32282" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-3346231f-629f-4d5f-b418-c913c8e32282" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-1410960b-65c0-4b3b-becd-4c3526422479" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-1410960b-65c0-4b3b-becd-4c3526422479" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 1410960b-65c0-4b3b-becd-4c3526422479 of volume 3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[585ea62d-06e7-4afe-b923-36b45e6f3f16]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:21 devstack sudo[115364]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:21 devstack sudo[115358]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.340s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed 1G" returned: 0 in 0.680s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:21 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Deleted volume successfully. Aug 26 03:19:21 devstack sudo[115370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed Aug 26 03:19:21 devstack sudo[115370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:21 devstack sudo[115367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d Aug 26 03:19:21 devstack sudo[115367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:21 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5cbe18b0-c9f4-4b85-b2e6-db03c808ea71 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-09bba0e9-64cb-48fc-9446-d9a0131b177d-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:21 devstack sudo[115369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 Aug 26 03:19:21 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[115367]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d" returned: 0 in 0.522s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[115380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d Aug 26 03:19:22 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[115370]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed" returned: 0 in 0.519s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed is being set with open permissions: ugo+rw Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479" returned: 0 in 0.578s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3346231f-629f-4d5f-b418-c913c8e32282(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:22 devstack sudo[115387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed Aug 26 03:19:22 devstack sudo[115387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc82ad34-5764-495f-a609-d13565b04c66]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[115389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 Aug 26 03:19:22 devstack sudo[115389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ca0259f7-579d-4f7a-b26f-546392d8648d" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-ca0259f7-579d-4f7a-b26f-546392d8648d" released by "delete_volume" :: held 0.948s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:22 devstack sudo[115387]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed" returned: 0 in 0.291s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created reservations ['28ea935d-ec44-4ec7-b758-d4e23a9aa4fa', '6858a900-f806-4a62-a4c2-f7bb782b4a7e', 'd6502a9b-3636-4a1a-9dc4-5e879727f814', '77eecc6c-7c53-4441-a348-50369339c8e8'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:22 devstack sudo[115393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info Aug 26 03:19:22 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[115395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:22 devstack sudo[115395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[115389]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282" returned: 0 in 0.557s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[115402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 Aug 26 03:19:22 devstack sudo[115402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info" returned: 0 in 0.339s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info is being set with open permissions: ugo+rw Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:22 devstack sudo[115405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info Aug 26 03:19:22 devstack sudo[115405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:22 devstack sudo[115395]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.332s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:22 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Deleted volume successfully. Aug 26 03:19:22 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-20e177ea-d9b6-47f3-aeb7-6a9a83573b6e tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-ca0259f7-579d-4f7a-b26f-546392d8648d-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:23 devstack sudo[115405]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.info" returned: 0 in 0.334s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:23 devstack sudo[115402]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479" returned: 0 in 0.421s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4a4fc93d-53f2-449b-b069-d740718da5fc tempest-ProjectReaderTests-1767369721 None] Create snapshot completed successfully Aug 26 03:19:23 devstack sudo[115412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479 Aug 26 03:19:23 devstack sudo[115412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:23 devstack sudo[115412]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282.1410960b-65c0-4b3b-becd-4c3526422479" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-1410960b-65c0-4b3b-becd-4c3526422479" released by "_delete_snapshot" :: held 1.909s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-3346231f-629f-4d5f-b418-c913c8e32282" released by "delete_snapshot" :: held 1.934s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Created reservations ['bb4617ba-2b39-4763-bb79-40bba44158da', 'd6e1dee0-9731-48db-ae35-b76cb8efb2c2', 'ed3f173a-7a56-4170-b932-bce3196c85db', '1433b3c0-8c8d-4306-b4ff-820ff2ee758e'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-6b6b01d7-9dde-4e92-85d7-d065d8f8b963 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-1410960b-65c0-4b3b-becd-4c3526422479-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-c709c308-3817-44e4-9219-da94c6544003-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-c709c308-3817-44e4-9219-da94c6544003-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-3346231f-629f-4d5f-b418-c913c8e32282-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "cinder-quobyte-c709c308-3817-44e4-9219-da94c6544003" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Lock "cinder-3346231f-629f-4d5f-b418-c913c8e32282-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-c709c308-3817-44e4-9219-da94c6544003" acquired by "delete_volume" :: waited 0.031s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[44226937-373c-4dc6-b104-e575a74284f6]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-3346231f-629f-4d5f-b418-c913c8e32282" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-3346231f-629f-4d5f-b418-c913c8e32282" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc93f5-c1ae-462e-9dfc-f6624e53dfe7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:23 devstack sudo[115416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 Aug 26 03:19:23 devstack sudo[115416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack sudo[115417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 Aug 26 03:19:24 devstack sudo[115417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-5e1e4cf2-f445-414b-b5cd-116ea28156ed-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Lock "cinder-5e1e4cf2-f445-414b-b5cd-116ea28156ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-67802d96-5d4e-49e1-82ef-cd23f5d05e59" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-67802d96-5d4e-49e1-82ef-cd23f5d05e59" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-5e1e4cf2-f445-414b-b5cd-116ea28156ed" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-5e1e4cf2-f445-414b-b5cd-116ea28156ed" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Deleting offline snapshot 5e1e4cf2-f445-414b-b5cd-116ea28156ed of volume 67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] snapshot_file for this snap is: volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[35359453-6e07-4eec-873f-c11af62bc043]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack sudo[115416]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003" returned: 0 in 0.520s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack sudo[115426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003 Aug 26 03:19:24 devstack sudo[115426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack sudo[115423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed Aug 26 03:19:24 devstack sudo[115423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack sudo[115417]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282" returned: 0 in 0.529s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack sudo[115430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282 Aug 26 03:19:24 devstack sudo[115430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack sudo[115426]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c709c308-3817-44e4-9219-da94c6544003" returned: 0 in 0.320s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-quobyte-c709c308-3817-44e4-9219-da94c6544003" released by "delete_volume" :: held 0.901s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:24 devstack sudo[115430]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-3346231f-629f-4d5f-b418-c913c8e32282" returned: 0 in 0.276s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack sudo[115423]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed" returned: 0 in 0.460s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-3346231f-629f-4d5f-b418-c913c8e32282" released by "delete_volume" :: held 0.908s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e012414-5bf8-4814-80c6-f0531c18914c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Created reservations ['afe95306-fcb8-4aef-822d-c1b1ccbfe653', 'c617279e-522a-4032-bbc2-0a380cc5cd1d', 'cc00e563-161a-4da7-a042-77faa4657920', 'a610b729-8c85-45f2-a787-f444f989860c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Created reservations ['5b7d052f-6d3b-4ec1-a002-ee52da704678', 'bc2559c4-d3d6-49f2-92e1-1e645d6762e2', 'a1811475-de40-4ac3-87fc-b5c85d3e5611', 'fdc7df33-b42a-425c-b84c-248bc48fb7c6'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:24 devstack sudo[115437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 Aug 26 03:19:24 devstack sudo[115437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:24 devstack sudo[115439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:24 devstack sudo[115439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:25 devstack sudo[115441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:25 devstack sudo[115441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:25 devstack sudo[115437]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59" returned: 0 in 0.432s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:25 devstack sudo[115446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed Aug 26 03:19:25 devstack sudo[115446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:25 devstack sudo[115439]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack sudo[115441]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.326s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Deleted volume successfully. Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-097e4477-7366-44e2-9343-1f7e4d3e6f77 tempest-CreateVolumesFromSourceVolumeTest-1094800544 None] Lock "cinder-c709c308-3817-44e4-9219-da94c6544003-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:25 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-922a60b1-9f18-4c41-a772-373be798d05a tempest-ProjectMemberTests-1946280196 None] Lock "cinder-3346231f-629f-4d5f-b418-c913c8e32282-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:25 devstack sudo[115446]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed" returned: 0 in 0.371s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:25 devstack sudo[115454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed Aug 26 03:19:25 devstack sudo[115454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:25 devstack sudo[115454]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59.5e1e4cf2-f445-414b-b5cd-116ea28156ed" returned: 0 in 0.275s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-5e1e4cf2-f445-414b-b5cd-116ea28156ed" released by "_delete_snapshot" :: held 1.705s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:25 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-67802d96-5d4e-49e1-82ef-cd23f5d05e59" released by "delete_snapshot" :: held 1.744s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Created reservations ['fade3a57-3951-4d7a-9efa-df27a1bfd30d', '67282471-6412-400d-9963-2c64e6d10c7c', 'da51ca5a-2137-4278-9dd3-acec23eec80f', 'dcaea1a8-7928-4685-b196-b5a96f68020b'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:DELETE=32,cinder:SELECT=240,cinder:INSERT=96,cinder:UPDATE=356 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:19:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Delete snapshot completed successfully. Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-74030d62-61ec-48c7-8ead-4dd57ed2178f tempest-ProjectReaderTests-1767369721 None] Lock "cinder-5e1e4cf2-f445-414b-b5cd-116ea28156ed-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-67802d96-5d4e-49e1-82ef-cd23f5d05e59-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-67802d96-5d4e-49e1-82ef-cd23f5d05e59-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:INSERT=95,cinder:SELECT=277,cinder:UPDATE=330,cinder:DELETE=28 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-67802d96-5d4e-49e1-82ef-cd23f5d05e59" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-67802d96-5d4e-49e1-82ef-cd23f5d05e59" acquired by "delete_volume" :: waited 0.034s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[60388085-bcf5-4a3a-954e-c0a6d8d8646f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (07473394-658e-4eaf-987a-e4ef1db0e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a39bd7d-ac16-44f9-9e44-cd5022ee9ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a39bd7d-ac16-44f9-9e44-cd5022ee9ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363767941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51259594-56af-45e3-9114-8a3ac34cf6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:27Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6b715c-48b3-418d-8a92-937000deedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:26 devstack sudo[115457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 Aug 26 03:19:26 devstack sudo[115457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f6b715c-48b3-418d-8a92-937000deedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f8bf67-3b0d-4e55-86cb-99c488ef7984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f8bf67-3b0d-4e55-86cb-99c488ef7984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51259594-56af-45e3-9114-8a3ac34cf6d2', 'volume_name': 'volume-51259594-56af-45e3-9114-8a3ac34cf6d2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00c4f27-6fad-4209-91fa-550218b59f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a00c4f27-6fad-4209-91fa-550218b59f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13676dd5-9ca5-462b-b33a-3ecb4e23948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Volume 51259594-56af-45e3-9114-8a3ac34cf6d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51259594-56af-45e3-9114-8a3ac34cf6d2', 'volume_size': 1} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1363767941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51259594-56af-45e3-9114-8a3ac34cf6d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:27Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Creating volume 51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:26 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:26 devstack sudo[115459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 1073741824 Aug 26 03:19:26 devstack sudo[115459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack sudo[115457]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59" returned: 0 in 0.522s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:27 devstack sudo[115465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59 Aug 26 03:19:27 devstack sudo[115465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack sudo[115459]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 1073741824" returned: 0 in 0.604s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:27 devstack sudo[115465]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:27 devstack sudo[115470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 Aug 26 03:19:27 devstack sudo[115470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-67802d96-5d4e-49e1-82ef-cd23f5d05e59" returned: 0 in 0.412s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-67802d96-5d4e-49e1-82ef-cd23f5d05e59" released by "delete_volume" :: held 1.079s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Created reservations ['6e018bdb-7f78-4e7a-ad78-49f880d9e6c7', '64edc687-59a9-4ac1-a2cd-62e47912232d', 'a8a5450c-adfa-435b-89f6-a164e23e0d6a', 'cacd9f8f-39ff-42c7-8c0e-9927098cb2e7'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:27 devstack sudo[115470]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2" returned: 0 in 0.313s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13676dd5-9ca5-462b-b33a-3ecb4e23948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51259594-56af-45e3-9114-8a3ac34cf6d2', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e048e2-d3ab-4aa0-8724-4ac1e44918bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:27 devstack sudo[115473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:27 devstack sudo[115473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Volume volume-51259594-56af-45e3-9114-8a3ac34cf6d2 (51259594-56af-45e3-9114-8a3ac34cf6d2): created successfully Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03e048e2-d3ab-4aa0-8724-4ac1e44918bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (07473394-658e-4eaf-987a-e4ef1db0e8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f062974f-135c-415b-b905-53ad299452b8 tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:19:28 devstack sudo[115473]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:28 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Deleted volume successfully. Aug 26 03:19:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-fd9c5340-c685-4aad-bc40-5509685ff014 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-67802d96-5d4e-49e1-82ef-cd23f5d05e59-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 6a4b642e-f7eb-4346-a414-ea97e70984e9 of volume 51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3709a-2893-48b9-92c0-953d976fe5cb]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:29 devstack sudo[115476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 Aug 26 03:19:29 devstack sudo[115476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (089ce12a-1e5a-4702-9622-1b3e6aafec5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96970e9-5213-4462-9516-06dcfff1f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96970e9-5213-4462-9516-06dcfff1f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533769463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8906e41-1d5a-4597-a5a2-5128e3765ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:29Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db718ffa-db48-4819-8f8e-f1c539a10d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db718ffa-db48-4819-8f8e-f1c539a10d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a625229-57e7-4761-95a2-485d96d23d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a625229-57e7-4761-95a2-485d96d23d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8906e41-1d5a-4597-a5a2-5128e3765ab6', 'volume_name': 'volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9522f703-8d97-478b-8043-3678df6919b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9522f703-8d97-478b-8043-3678df6919b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a86cd33-7bcb-4d8b-b48f-d39364174770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:29 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Volume f8906e41-1d5a-4597-a5a2-5128e3765ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6', 'volume_size': 1} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:29 devstack sudo[115476]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2" returned: 0 in 0.626s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:29 devstack sudo[115516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 1G Aug 26 03:19:29 devstack sudo[115516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:30 devstack sudo[115516]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 1G" returned: 0 in 0.536s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51259594-56af-45e3-9114-8a3ac34cf6d2 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:30 devstack sudo[115524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51259594-56af-45e3-9114-8a3ac34cf6d2 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 Aug 26 03:19:30 devstack sudo[115524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:30 devstack sudo[115524]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51259594-56af-45e3-9114-8a3ac34cf6d2 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9" returned: 0 in 0.332s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:30 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 is being set with open permissions: ugo+rw Aug 26 03:19:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:30 devstack sudo[115529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 Aug 26 03:19:30 devstack sudo[115529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:30 devstack sudo[115529]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9" returned: 0 in 0.257s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:30 devstack sudo[115532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info Aug 26 03:19:30 devstack sudo[115532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack sudo[115532]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info is being set with open permissions: ugo+rw Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[115535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info Aug 26 03:19:31 devstack sudo[115535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack sudo[115535]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.info" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.856s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-533769463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8906e41-1d5a-4597-a5a2-5128e3765ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:29Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Creating volume f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:31 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[115538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 1073741824 Aug 26 03:19:31 devstack sudo[115538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:31 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-1cfc34a8-ef1c-426b-adf3-fc58acd33fa8 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:19:31 devstack sudo[115538]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 1073741824" returned: 0 in 0.397s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:31 devstack sudo[115544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 Aug 26 03:19:31 devstack sudo[115544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:32 devstack sudo[115544]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a86cd33-7bcb-4d8b-b48f-d39364174770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a631bd85-9205-4631-985b-c3337ba0aa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:32 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Volume volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 (f8906e41-1d5a-4597-a5a2-5128e3765ab6): created successfully Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a631bd85-9205-4631-985b-c3337ba0aa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (089ce12a-1e5a-4702-9622-1b3e6aafec5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-34ef8f96-41c3-4ade-acec-22c3b96b9aa1 tempest-ProjectReaderTests-1767369721 None] Created volume successfully. Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-6a4b642e-f7eb-4346-a414-ea97e70984e9-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-6a4b642e-f7eb-4346-a414-ea97e70984e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-51259594-56af-45e3-9114-8a3ac34cf6d2" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-51259594-56af-45e3-9114-8a3ac34cf6d2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-6a4b642e-f7eb-4346-a414-ea97e70984e9" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-6a4b642e-f7eb-4346-a414-ea97e70984e9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 6a4b642e-f7eb-4346-a414-ea97e70984e9 of volume 51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0b22d3-8156-48ba-a1b1-a0f3b6051954]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:32 devstack sudo[115547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 Aug 26 03:19:32 devstack sudo[115547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Creating offline snapshot bfd1b23e-079d-474f-8873-5777b2688c42 of volume f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:32 devstack sudo[115547]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9" returned: 0 in 0.406s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51259594-56af-45e3-9114-8a3ac34cf6d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a763250-e1d2-404e-931c-5a2aa1f3a6ed]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2022a0-1c12-4d34-b47c-35123d7771b3]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:32 devstack sudo[115552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 Aug 26 03:19:32 devstack sudo[115552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:32 devstack sudo[115553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 Aug 26 03:19:32 devstack sudo[115553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[115552]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6" returned: 0 in 0.373s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[115561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 1G Aug 26 03:19:33 devstack sudo[115561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[115553]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2" returned: 0 in 0.425s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[115564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 Aug 26 03:19:33 devstack sudo[115564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[115564]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack sudo[115561]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9" returned: 0 in 0.342s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 1G" returned: 0 in 0.423s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack sudo[115575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9 Aug 26 03:19:33 devstack sudo[115575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[115576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 Aug 26 03:19:33 devstack sudo[115576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack sudo[115575]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2.6a4b642e-f7eb-4346-a414-ea97e70984e9" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-6a4b642e-f7eb-4346-a414-ea97e70984e9" released by "_delete_snapshot" :: held 1.540s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-51259594-56af-45e3-9114-8a3ac34cf6d2" released by "delete_snapshot" :: held 1.565s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:33 devstack sudo[115576]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42" returned: 0 in 0.331s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:33 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 is being set with open permissions: ugo+rw Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Created reservations ['0781ba42-a1b5-401d-b331-340b6855773e', 'b11991f4-5542-4238-8a00-09503374fa94', '6a8de222-a06c-43dc-a451-1b5656fb596e', 'afe6a90a-755c-4b1c-91a4-45c1fb7bcbf5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:33 devstack sudo[115583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 Aug 26 03:19:33 devstack sudo[115583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:33 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:19:33 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-177cf2df-1f8f-4f29-9b65-47ccefe8afc5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-6a4b642e-f7eb-4346-a414-ea97e70984e9-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:34 devstack sudo[115583]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42" returned: 0 in 0.241s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:34 devstack sudo[115586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info Aug 26 03:19:34 devstack sudo[115586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:34 devstack sudo[115586]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-51259594-56af-45e3-9114-8a3ac34cf6d2-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info" returned: 0 in 0.266s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info is being set with open permissions: ugo+rw Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-51259594-56af-45e3-9114-8a3ac34cf6d2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:34 devstack sudo[115589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info Aug 26 03:19:34 devstack sudo[115589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-51259594-56af-45e3-9114-8a3ac34cf6d2" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-51259594-56af-45e3-9114-8a3ac34cf6d2" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa7b1c0-c876-4dc5-8ed3-7b1e6a501d93]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:34 devstack sudo[115589]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.info" returned: 0 in 0.267s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack sudo[115591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 Aug 26 03:19:34 devstack sudo[115591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.016s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:34 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-09518fdd-5589-4b61-a3b0-976ff2f60193 tempest-ProjectReaderTests-1767369721 None] Create snapshot completed successfully Aug 26 03:19:34 devstack sudo[115591]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2" returned: 0 in 0.409s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:34 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:34 devstack sudo[115597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2 Aug 26 03:19:34 devstack sudo[115597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:35 devstack sudo[115597]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-51259594-56af-45e3-9114-8a3ac34cf6d2" returned: 0 in 0.277s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-51259594-56af-45e3-9114-8a3ac34cf6d2" released by "delete_volume" :: held 0.759s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Created reservations ['f0b41390-848f-406d-a094-2bf407917bc5', 'cb87fc3e-4716-4c03-b6cd-4c3b985a49fd', '1501b9a7-298a-492a-909c-a7e835792e72', 'ae773809-97e3-4904-9774-4ae8bd1220cb'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:35 devstack sudo[115600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:35 devstack sudo[115600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:35 devstack sudo[115600]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.339s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:35 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-283e40b7-19f5-4b7b-bd29-bdd931945754 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-51259594-56af-45e3-9114-8a3ac34cf6d2-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-bfd1b23e-079d-474f-8873-5777b2688c42-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Lock "cinder-bfd1b23e-079d-474f-8873-5777b2688c42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-f8906e41-1d5a-4597-a5a2-5128e3765ab6" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-f8906e41-1d5a-4597-a5a2-5128e3765ab6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-bfd1b23e-079d-474f-8873-5777b2688c42" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-bfd1b23e-079d-474f-8873-5777b2688c42" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Deleting offline snapshot bfd1b23e-079d-474f-8873-5777b2688c42 of volume f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:35 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] snapshot_file for this snap is: volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[616aad83-dcec-405e-9434-0268fa55a63d]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[115604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 Aug 26 03:19:36 devstack sudo[115604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (ff62ff33-cc12-4ca5-a60d-c35a2603e644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12dc871-2c5c-4890-ab70-c1185ebe7e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12dc871-2c5c-4890-ab70-c1185ebe7e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679235553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549540e0-cd20-496f-b724-38f2d549240b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:36Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fb41f9-81cd-4d18-8a84-3b480a8f8e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50fb41f9-81cd-4d18-8a84-3b480a8f8e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de3bebf-33ba-48f3-88da-657cb3d74df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de3bebf-33ba-48f3-88da-657cb3d74df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549540e0-cd20-496f-b724-38f2d549240b', 'volume_name': 'volume-549540e0-cd20-496f-b724-38f2d549240b', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41cf477-b398-41f9-be26-4bd70d4b44ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a41cf477-b398-41f9-be26-4bd70d4b44ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e490592e-e204-44f2-8878-f969b45a6a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:36 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Volume 549540e0-cd20-496f-b724-38f2d549240b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549540e0-cd20-496f-b724-38f2d549240b', 'volume_size': 1} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1679235553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549540e0-cd20-496f-b724-38f2d549240b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:36Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Creating volume 549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:36 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[115606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b 1073741824 Aug 26 03:19:36 devstack sudo[115606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack sudo[115604]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42" returned: 0 in 0.486s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[427f3a13-f0cd-4d3a-b181-987b36d43c4c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[115611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 Aug 26 03:19:36 devstack sudo[115611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack sudo[115606]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b 1073741824" returned: 0 in 0.480s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[115619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b Aug 26 03:19:36 devstack sudo[115619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:36 devstack sudo[115611]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6" returned: 0 in 0.404s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:36 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:36 devstack sudo[115621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 Aug 26 03:19:36 devstack sudo[115621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:37 devstack sudo[115619]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b" returned: 0 in 0.307s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e490592e-e204-44f2-8878-f969b45a6a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549540e0-cd20-496f-b724-38f2d549240b', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be1ec73-c01c-4fc4-be2f-53da0ec5318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Volume volume-549540e0-cd20-496f-b724-38f2d549240b (549540e0-cd20-496f-b724-38f2d549240b): created successfully Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be1ec73-c01c-4fc4-be2f-53da0ec5318b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (ff62ff33-cc12-4ca5-a60d-c35a2603e644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e14eaf15-2a32-4b85-959e-b76e62d74f8d tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:19:37 devstack sudo[115621]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42" returned: 0 in 0.397s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:37 devstack sudo[115628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42 Aug 26 03:19:37 devstack sudo[115628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:37 devstack sudo[115628]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6.bfd1b23e-079d-474f-8873-5777b2688c42" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-bfd1b23e-079d-474f-8873-5777b2688c42" released by "_delete_snapshot" :: held 1.652s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-f8906e41-1d5a-4597-a5a2-5128e3765ab6" released by "delete_snapshot" :: held 1.678s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Created reservations ['43d08804-a15e-4c3c-bb62-c5ab06c4a904', '4c5bce4b-ea75-452d-9be2-d1449a89d134', 'ead665be-680e-43a3-afcb-4dcfce30e4cc', 'e7d04b20-5519-4569-867a-be69ee741a60'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:37 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Delete snapshot completed successfully. Aug 26 03:19:37 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-dff67ac5-070a-4ad4-8dc0-c7b6fb8da41a tempest-ProjectReaderTests-1767369721 None] Lock "cinder-bfd1b23e-079d-474f-8873-5777b2688c42-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-f8906e41-1d5a-4597-a5a2-5128e3765ab6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Lock "cinder-f8906e41-1d5a-4597-a5a2-5128e3765ab6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-f8906e41-1d5a-4597-a5a2-5128e3765ab6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-f8906e41-1d5a-4597-a5a2-5128e3765ab6" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9ae2ea-fca5-40b9-8866-abef300f853c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[115631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 Aug 26 03:19:38 devstack sudo[115631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 71051cd5-44eb-4b78-84dc-f8842c87b118 of volume 549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[93542693-1834-42b6-aea6-bed22177497c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[115633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b Aug 26 03:19:38 devstack sudo[115633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[115631]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6" returned: 0 in 0.398s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[115638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6 Aug 26 03:19:38 devstack sudo[115638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack sudo[115633]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b" returned: 0 in 0.405s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:38 devstack sudo[115638]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f8906e41-1d5a-4597-a5a2-5128e3765ab6" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:38 devstack sudo[115644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 1G Aug 26 03:19:38 devstack sudo[115644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-f8906e41-1d5a-4597-a5a2-5128e3765ab6" released by "delete_volume" :: held 0.736s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:38 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Created reservations ['ed7a7dcf-bee0-4f32-8dcf-06d3338be666', '42b24387-30b2-4641-98f7-afb80234fd76', '2f8fd7c5-ddf6-4a6c-82bb-ac627f0a508f', '235cd6b8-aa97-44da-a38e-7fc86bc15e39'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:39 devstack sudo[115646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:39 devstack sudo[115646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:39 devstack sudo[115646]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.309s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:39 devstack sudo[115644]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 1G" returned: 0 in 0.484s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549540e0-cd20-496f-b724-38f2d549240b -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:39 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Deleted volume successfully. Aug 26 03:19:39 devstack sudo[115653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549540e0-cd20-496f-b724-38f2d549240b -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 Aug 26 03:19:39 devstack sudo[115653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8a9972ab-93e0-452d-9255-239bce5043ba tempest-ProjectReaderTests-1767369721 None] Lock "cinder-f8906e41-1d5a-4597-a5a2-5128e3765ab6-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:39 devstack sudo[115653]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549540e0-cd20-496f-b724-38f2d549240b -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118" returned: 0 in 0.369s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:39 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 is being set with open permissions: ugo+rw Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:39 devstack sudo[115658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 Aug 26 03:19:39 devstack sudo[115658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (4cc8d3ea-512a-4ab9-9157-875c9e44fbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc26ba2a-5e15-4b3b-982a-9f8392f833f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc26ba2a-5e15-4b3b-982a-9f8392f833f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224207640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44906b63-390e-4dd1-bb15-38834dc04075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:40Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796bae64-87ad-4b48-b922-4dfcd3a757b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (796bae64-87ad-4b48-b922-4dfcd3a757b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d9cd84-e172-4726-8688-2ea4b1fd7078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d9cd84-e172-4726-8688-2ea4b1fd7078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44906b63-390e-4dd1-bb15-38834dc04075', 'volume_name': 'volume-44906b63-390e-4dd1-bb15-38834dc04075', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca52d50-034a-4add-9885-b505f9e0bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bca52d50-034a-4add-9885-b505f9e0bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61ead96-e32f-47f5-889a-bf3c17acf9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:39 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Volume 44906b63-390e-4dd1-bb15-38834dc04075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44906b63-390e-4dd1-bb15-38834dc04075', 'volume_size': 1} Aug 26 03:19:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:40 devstack sudo[115658]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118" returned: 0 in 0.280s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:40 devstack sudo[115661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info Aug 26 03:19:40 devstack sudo[115661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:40 devstack sudo[115661]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info" returned: 0 in 0.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:40 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info is being set with open permissions: ugo+rw Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:40 devstack sudo[115664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info Aug 26 03:19:40 devstack sudo[115664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:40 devstack sudo[115664]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.info" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1224207640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44906b63-390e-4dd1-bb15-38834dc04075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0a83e51ae054c9290e23d93a892ef6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:40Z,use_quota=True,user_id='96f1508eb405466797930d4172f85b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Creating volume 44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:40 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:40 devstack sudo[115667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 1073741824 Aug 26 03:19:40 devstack sudo[115667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3a677223-2b0c-4d41-9b92-b399c1a03db7 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:19:41 devstack sudo[115667]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 1073741824" returned: 0 in 0.454s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:41 devstack sudo[115673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 Aug 26 03:19:41 devstack sudo[115673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:41 devstack sudo[115673]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075" returned: 0 in 0.245s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61ead96-e32f-47f5-889a-bf3c17acf9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44906b63-390e-4dd1-bb15-38834dc04075', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de28521-6fca-4bdf-891f-7dbed26915fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Volume volume-44906b63-390e-4dd1-bb15-38834dc04075 (44906b63-390e-4dd1-bb15-38834dc04075): created successfully Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de28521-6fca-4bdf-891f-7dbed26915fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Flow 'volume_create_manager' (4cc8d3ea-512a-4ab9-9157-875c9e44fbfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:41 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f4f4d5b5-9dec-4d4a-b46d-72fe3341e818 tempest-ProjectReaderTests-1767369721 None] Created volume successfully. Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-71051cd5-44eb-4b78-84dc-f8842c87b118-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Lock "cinder-71051cd5-44eb-4b78-84dc-f8842c87b118-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-549540e0-cd20-496f-b724-38f2d549240b" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-549540e0-cd20-496f-b724-38f2d549240b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-71051cd5-44eb-4b78-84dc-f8842c87b118" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-71051cd5-44eb-4b78-84dc-f8842c87b118" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 71051cd5-44eb-4b78-84dc-f8842c87b118 of volume 549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d4400f-1b4c-4fff-b57f-48d576aacd57]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:41 devstack sudo[115676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 Aug 26 03:19:41 devstack sudo[115676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Creating offline snapshot 373da283-1257-421d-9da5-eefd1f6c3442 of volume 44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1baee1-69bb-4571-b259-3b9fddc9c214]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:42 devstack sudo[115676]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118" returned: 0 in 0.377s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-549540e0-cd20-496f-b724-38f2d549240b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfcaf3f-27dc-41b4-b231-26d694943259]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:42 devstack sudo[115682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 Aug 26 03:19:42 devstack sudo[115682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack sudo[115683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b Aug 26 03:19:42 devstack sudo[115683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack sudo[115682]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075" returned: 0 in 0.386s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:42 devstack sudo[115689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 1G Aug 26 03:19:42 devstack sudo[115689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack sudo[115683]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:42 devstack sudo[115694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 Aug 26 03:19:42 devstack sudo[115694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack sudo[115689]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 1G" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44906b63-390e-4dd1-bb15-38834dc04075 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:42 devstack sudo[115694]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118" returned: 0 in 0.331s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:42 devstack sudo[115703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44906b63-390e-4dd1-bb15-38834dc04075 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 Aug 26 03:19:42 devstack sudo[115703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:42 devstack sudo[115705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118 Aug 26 03:19:42 devstack sudo[115705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:43 devstack sudo[115705]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b.71051cd5-44eb-4b78-84dc-f8842c87b118" returned: 0 in 0.247s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:43 devstack sudo[115703]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44906b63-390e-4dd1-bb15-38834dc04075 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442" returned: 0 in 0.290s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:43 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 is being set with open permissions: ugo+rw Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-71051cd5-44eb-4b78-84dc-f8842c87b118" released by "_delete_snapshot" :: held 1.446s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-549540e0-cd20-496f-b724-38f2d549240b" released by "delete_snapshot" :: held 1.471s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:43 devstack sudo[115711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 Aug 26 03:19:43 devstack sudo[115711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Created reservations ['9b9c8beb-b389-4820-bb15-b0bbced3c87e', '5bf9fceb-182f-4e64-987b-a6198611a51e', '5a01f49a-cfdf-4594-bc7b-56109429f347', '31da4a75-9c3d-4f6f-9ebc-259ab74c273c'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-040755fe-9041-4921-bb1d-73a3e6e520fd tempest-ProjectMemberTests-1946280196 None] Lock "cinder-71051cd5-44eb-4b78-84dc-f8842c87b118-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:43 devstack sudo[115711]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:43 devstack sudo[115714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info Aug 26 03:19:43 devstack sudo[115714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:43 devstack sudo[115714]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info" returned: 0 in 0.245s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:43 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info is being set with open permissions: ugo+rw Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:43 devstack sudo[115718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info Aug 26 03:19:43 devstack sudo[115718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-549540e0-cd20-496f-b724-38f2d549240b-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-549540e0-cd20-496f-b724-38f2d549240b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-549540e0-cd20-496f-b724-38f2d549240b" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-549540e0-cd20-496f-b724-38f2d549240b" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:43 devstack sudo[115718]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.info" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.899s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6892618-5ab8-4c95-9827-fc194bd4408b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3b0049fa-164c-412c-bb5a-d7a6ceee4665 tempest-ProjectReaderTests-1767369721 None] Create snapshot completed successfully Aug 26 03:19:44 devstack sudo[115721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b Aug 26 03:19:44 devstack sudo[115721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-373da283-1257-421d-9da5-eefd1f6c3442-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Lock "cinder-373da283-1257-421d-9da5-eefd1f6c3442-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-44906b63-390e-4dd1-bb15-38834dc04075" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-44906b63-390e-4dd1-bb15-38834dc04075" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-373da283-1257-421d-9da5-eefd1f6c3442" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-373da283-1257-421d-9da5-eefd1f6c3442" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Deleting offline snapshot 373da283-1257-421d-9da5-eefd1f6c3442 of volume 44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] snapshot_file for this snap is: volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ad51ba-8787-4635-8aef-51a100c4fbb7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack sudo[115721]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b" returned: 0 in 0.363s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack sudo[115727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b Aug 26 03:19:44 devstack sudo[115727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack sudo[115725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 Aug 26 03:19:44 devstack sudo[115725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack sudo[115727]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-549540e0-cd20-496f-b724-38f2d549240b" returned: 0 in 0.239s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-549540e0-cd20-496f-b724-38f2d549240b" released by "delete_volume" :: held 0.661s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:44 devstack sudo[115725]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442" returned: 0 in 0.348s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44906b63-390e-4dd1-bb15-38834dc04075(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd1553d-c14b-4af5-a521-b369f09866e5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Created reservations ['2b837ec1-487e-459a-8d1c-20bda4152b9d', '4f673e74-3bfb-458b-ae46-178052bc08b8', '6c36eec8-58e5-45a0-804f-1ef22c8c358c', '89568ef9-1920-41c1-85d1-5bda01cfdbb0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:44 devstack sudo[115734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 Aug 26 03:19:44 devstack sudo[115735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:44 devstack sudo[115734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack sudo[115735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:44 devstack sudo[115735]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:44 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-87897372-76b8-4db7-8be6-e736da2aa102 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-549540e0-cd20-496f-b724-38f2d549240b-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:45 devstack sudo[115734]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075" returned: 0 in 0.383s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[115742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 Aug 26 03:19:45 devstack sudo[115742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack sudo[115742]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442" returned: 0 in 0.393s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[115747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442 Aug 26 03:19:45 devstack sudo[115747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (21222223-6671-4e6c-9a63-566544eadccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae96b89-54e6-41e2-bfee-478587c8d827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae96b89-54e6-41e2-bfee-478587c8d827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929209549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82a3baf-809a-4ee2-bc46-aaba6cd60669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:45Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd5526c-7225-4e76-9c3b-82d7e8bb2409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd5526c-7225-4e76-9c3b-82d7e8bb2409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d89d589-9d55-41e8-98c9-3e7bbbea417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d89d589-9d55-41e8-98c9-3e7bbbea417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f82a3baf-809a-4ee2-bc46-aaba6cd60669', 'volume_name': 'volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb66a1af-9812-4d89-9845-6f86e17c9511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb66a1af-9812-4d89-9845-6f86e17c9511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82f74d8-a7e7-44e5-816c-d9ad4185cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:45 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Volume f82a3baf-809a-4ee2-bc46-aaba6cd60669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669', 'volume_size': 1} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1929209549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f82a3baf-809a-4ee2-bc46-aaba6cd60669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:45Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Creating volume f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:45 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:45 devstack sudo[115749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 1073741824 Aug 26 03:19:45 devstack sudo[115749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:45 devstack sudo[115747]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075.373da283-1257-421d-9da5-eefd1f6c3442" returned: 0 in 0.244s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-373da283-1257-421d-9da5-eefd1f6c3442" released by "_delete_snapshot" :: held 1.464s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-44906b63-390e-4dd1-bb15-38834dc04075" released by "delete_snapshot" :: held 1.483s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Created reservations ['d5b84043-a5f9-48a9-bc86-1307e56c1141', '45ef736e-be09-4bab-9366-f1c40ef3d81e', 'e4c84206-ea94-4afb-b266-c08d6aa1849c', 'cb08194e-7083-4aff-ab31-cf83a1e594bf'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Delete snapshot completed successfully. Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-23211afa-6103-440d-8075-5d905ca3893d tempest-ProjectReaderTests-1767369721 None] Lock "cinder-373da283-1257-421d-9da5-eefd1f6c3442-delete_snapshot" released by "delete_snapshot" :: held 1.614s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:45 devstack sudo[115749]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 1073741824" returned: 0 in 0.397s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[115755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 Aug 26 03:19:46 devstack sudo[115755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[115755]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669" returned: 0 in 0.251s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e82f74d8-a7e7-44e5-816c-d9ad4185cc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59399df2-08ad-4f38-bc14-d2c0885c4a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Volume volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 (f82a3baf-809a-4ee2-bc46-aaba6cd60669): created successfully Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59399df2-08ad-4f38-bc14-d2c0885c4a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (21222223-6671-4e6c-9a63-566544eadccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:46 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2e69c723-f0c1-4fe4-bdb7-5fa51a0b2eb9 tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-44906b63-390e-4dd1-bb15-38834dc04075-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-44906b63-390e-4dd1-bb15-38834dc04075-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "cinder-quobyte-44906b63-390e-4dd1-bb15-38834dc04075" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-44906b63-390e-4dd1-bb15-38834dc04075" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2c9102-3c99-45a2-9fdc-17f7df13504c]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[115758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 Aug 26 03:19:46 devstack sudo[115758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 4b0b1236-8880-4515-9918-40adc901a67d of volume f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bc2660-2ac8-495e-bc2f-188fcde0864a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[115760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 Aug 26 03:19:46 devstack sudo[115760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:46 devstack sudo[115758]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:46 devstack sudo[115765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075 Aug 26 03:19:46 devstack sudo[115765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:47 devstack sudo[115760]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack sudo[115765]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-44906b63-390e-4dd1-bb15-38834dc04075" returned: 0 in 0.241s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack sudo[115771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d 1G Aug 26 03:19:47 devstack sudo[115771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-quobyte-44906b63-390e-4dd1-bb15-38834dc04075" released by "delete_volume" :: held 0.700s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Created reservations ['5ace3e30-f7b9-433b-9581-61ca8d5840d2', '5c71ca5c-8513-496c-98e3-84f56b518f03', 'a2e9dd01-d0c8-4430-b48f-9983c6b0779d', 'c9299891-b518-4f64-85a1-37126fb12c39'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack sudo[115773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:47 devstack sudo[115773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:47 devstack sudo[115771]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d 1G" returned: 0 in 0.423s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack sudo[115779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d Aug 26 03:19:47 devstack sudo[115779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:47 devstack sudo[115773]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Deleted volume successfully. Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-d7a2f3eb-2882-45d0-a0c7-45c0e53fbd37 tempest-ProjectReaderTests-1767369721 None] Lock "cinder-44906b63-390e-4dd1-bb15-38834dc04075-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:47 devstack sudo[115779]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d" returned: 0 in 0.329s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:47 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d is being set with open permissions: ugo+rw Aug 26 03:19:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:47 devstack sudo[115784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d Aug 26 03:19:47 devstack sudo[115784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[115784]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack sudo[115787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info Aug 26 03:19:48 devstack sudo[115787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[115787]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info" returned: 0 in 0.278s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info is being set with open permissions: ugo+rw Aug 26 03:19:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:48 devstack sudo[115790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info Aug 26 03:19:48 devstack sudo[115790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:48 devstack sudo[115790]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.info" returned: 0 in 0.261s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.062s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-2d7b1994-9703-432d-b7fa-c76496fe6321 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-4b0b1236-8880-4515-9918-40adc901a67d-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Lock "cinder-4b0b1236-8880-4515-9918-40adc901a67d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-f82a3baf-809a-4ee2-bc46-aaba6cd60669" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-f82a3baf-809a-4ee2-bc46-aaba6cd60669" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-4b0b1236-8880-4515-9918-40adc901a67d" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-4b0b1236-8880-4515-9918-40adc901a67d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 4b0b1236-8880-4515-9918-40adc901a67d of volume f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf072e3-af93-4626-ae63-2c8452a43c94]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:49 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:50 devstack sudo[115793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d Aug 26 03:19:50 devstack sudo[115793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:50 devstack sudo[115793]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d" returned: 0 in 0.377s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:50 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab82fa89-cb06-4d27-9ffd-8827bdde262a]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:50 devstack sudo[115799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 Aug 26 03:19:50 devstack sudo[115799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:50 devstack sudo[115799]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669" returned: 0 in 0.388s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:50 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:50 devstack sudo[115804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d Aug 26 03:19:50 devstack sudo[115804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:51 devstack sudo[115804]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d" returned: 0 in 0.358s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:51 devstack sudo[115809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d Aug 26 03:19:51 devstack sudo[115809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:51 devstack sudo[115809]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669.4b0b1236-8880-4515-9918-40adc901a67d" returned: 0 in 0.275s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-4b0b1236-8880-4515-9918-40adc901a67d" released by "_delete_snapshot" :: held 1.494s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-f82a3baf-809a-4ee2-bc46-aaba6cd60669" released by "delete_snapshot" :: held 1.518s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Created reservations ['53376807-de0b-4e37-a747-b5e2201aa073', 'ed19bff4-786f-46ab-be3e-8b0753a5a3ca', '1cbaa33f-0364-4070-8ef3-2523a4deb865', 'e950729c-c628-4ad3-8529-2a7cfe28c260'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:51 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-7cd7a0f6-5d58-48a9-95b2-fc0eaf2b539f tempest-ProjectMemberTests-1946280196 None] Lock "cinder-4b0b1236-8880-4515-9918-40adc901a67d-delete_snapshot" released by "delete_snapshot" :: held 1.705s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:51 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-f82a3baf-809a-4ee2-bc46-aaba6cd60669-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-f82a3baf-809a-4ee2-bc46-aaba6cd60669-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-f82a3baf-809a-4ee2-bc46-aaba6cd60669" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-f82a3baf-809a-4ee2-bc46-aaba6cd60669" acquired by "delete_volume" :: waited 0.024s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[7257bcab-fc7a-41c2-95fa-6feeb4ce6624]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:52 devstack sudo[115812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 Aug 26 03:19:52 devstack sudo[115812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:52 devstack sudo[115812]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669" returned: 0 in 0.394s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:52 devstack sudo[115817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669 Aug 26 03:19:52 devstack sudo[115817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:52 devstack sudo[115817]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-f82a3baf-809a-4ee2-bc46-aaba6cd60669" returned: 0 in 0.275s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-f82a3baf-809a-4ee2-bc46-aaba6cd60669" released by "delete_volume" :: held 0.747s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Created reservations ['1e0a4f3f-7b6f-49f8-9304-968abb54707f', 'eff37a96-8321-4044-900c-5b87cb47edea', '81db6379-3132-4237-8ec5-2ec1d1892ab8', 'dd609351-884d-40ea-9cd1-262b71d1a3f0'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:52 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:53 devstack sudo[115820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:19:53 devstack sudo[115820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:53 devstack sudo[115820]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.288s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:19:53 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-0fc9be63-5599-441d-893e-b08340a18207 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-f82a3baf-809a-4ee2-bc46-aaba6cd60669-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (ec3cd784-1f67-476b-9037-f5545cd95d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdd1cfa-1ce5-4fec-bd65-0bd885abf886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdd1cfa-1ce5-4fec-bd65-0bd885abf886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345480742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e0e59d-f021-4dfc-b969-9a9ce85f3ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:54Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030e03f1-9d0d-4864-9bd9-7b93f9ada616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:53 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (030e03f1-9d0d-4864-9bd9-7b93f9ada616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0921728-27d6-48c6-add9-33b04bd89a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0921728-27d6-48c6-add9-33b04bd89a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84e0e59d-f021-4dfc-b969-9a9ce85f3ba1', 'volume_name': 'volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fdb74f-7612-4dd9-8c4b-c153b7bc2390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fdb74f-7612-4dd9-8c4b-c153b7bc2390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b132af1-aff0-4282-a287-1c1e8a013c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:54 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Volume 84e0e59d-f021-4dfc-b969-9a9ce85f3ba1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1', 'volume_size': 1} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1345480742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84e0e59d-f021-4dfc-b969-9a9ce85f3ba1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:19:54Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Creating volume 84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:19:54 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:54 devstack sudo[115824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 1073741824 Aug 26 03:19:54 devstack sudo[115824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:54 devstack sudo[115824]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 1073741824" returned: 0 in 0.452s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:54 devstack sudo[115830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 Aug 26 03:19:54 devstack sudo[115830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:54 devstack sudo[115830]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b132af1-aff0-4282-a287-1c1e8a013c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d71adb-1b40-4174-b357-367728165059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:19:54 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Volume volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 (84e0e59d-f021-4dfc-b969-9a9ce85f3ba1): created successfully Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d71adb-1b40-4174-b357-367728165059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:19:54 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (ec3cd784-1f67-476b-9037-f5545cd95d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:19:54 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-50e6bd1c-6bb8-4dd8-afb0-8db8b6565ad4 tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:19:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:19:55 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot 059b70fe-9274-4146-9094-d4a5c6b97258 of volume 84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec29ce8-608b-40cd-be05-1f346c99f5ca]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:56 devstack sudo[115833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 Aug 26 03:19:56 devstack sudo[115833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:56 devstack sudo[115833]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" returned: 0 in 0.386s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:56 devstack sudo[115838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 1G Aug 26 03:19:56 devstack sudo[115838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:56 devstack sudo[115838]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 1G" returned: 0 in 0.456s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:56 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:56 devstack sudo[115843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 Aug 26 03:19:56 devstack sudo[115843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:57 devstack sudo[115843]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258" returned: 0 in 0.305s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:57 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 is being set with open permissions: ugo+rw Aug 26 03:19:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:57 devstack sudo[115848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 Aug 26 03:19:57 devstack sudo[115848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:57 devstack sudo[115848]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258" returned: 0 in 0.290s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:57 devstack sudo[115851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info Aug 26 03:19:57 devstack sudo[115851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:57 devstack sudo[115851]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:57 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info is being set with open permissions: ugo+rw Aug 26 03:19:57 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:57 devstack sudo[115854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info Aug 26 03:19:57 devstack sudo[115854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.info" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:58 devstack sudo[115854]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:58 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:19:58 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8786d0a6-3c91-49fe-8fa4-80c16c974e75 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-059b70fe-9274-4146-9094-d4a5c6b97258-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-059b70fe-9274-4146-9094-d4a5c6b97258-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-059b70fe-9274-4146-9094-d4a5c6b97258" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-059b70fe-9274-4146-9094-d4a5c6b97258" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot 059b70fe-9274-4146-9094-d4a5c6b97258 of volume 84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b1c2a-17a0-44af-a5f9-2123593ef3ae]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:59 devstack sudo[115857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 Aug 26 03:19:59 devstack sudo[115857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:19:59 devstack sudo[115857]: pam_unix(sudo:session): session closed for user root Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258" returned: 0 in 0.358s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c59670-40f4-4a58-aca0-161f52408a4b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:19:59 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:19:59 devstack sudo[115863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 Aug 26 03:19:59 devstack sudo[115863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:00 devstack sudo[115863]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" returned: 0 in 0.366s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:00 devstack sudo[115868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 Aug 26 03:20:00 devstack sudo[115868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:00 devstack sudo[115868]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258" returned: 0 in 0.409s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:00 devstack sudo[115873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258 Aug 26 03:20:00 devstack sudo[115873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:00 devstack sudo[115873]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1.059b70fe-9274-4146-9094-d4a5c6b97258" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-059b70fe-9274-4146-9094-d4a5c6b97258" released by "_delete_snapshot" :: held 1.515s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" released by "delete_snapshot" :: held 1.538s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Created reservations ['6e6e9ca6-3300-4494-8351-de4ffa099301', 'a57d7777-3b59-44ae-aee2-a6ae9ecc0be3', '1725e90b-2642-4342-90e3-83a92856f5a0', '53726330-7371-4e5c-9181-6564c9a98b7f'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:00 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:20:00 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-29ffba59-e0ed-4e9b-8b20-a3f712e54b6e tempest-ProjectMemberTests-1946280196 None] Lock "cinder-059b70fe-9274-4146-9094-d4a5c6b97258-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f189ca8-d203-46ed-9fdd-2b27ff44e6f5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 Aug 26 03:20:01 devstack sudo[115876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:01 devstack sudo[115876]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" returned: 0 in 0.427s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:01 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:01 devstack sudo[115885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1 Aug 26 03:20:01 devstack sudo[115885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:02 devstack sudo[115885]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" returned: 0 in 0.270s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1" released by "delete_volume" :: held 0.764s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Created reservations ['c4fec840-4593-4d3a-ba25-3c672f477c8f', '6e474a9b-5db0-44ae-87f0-31077a3812b4', '904a3936-6601-4b00-9a29-b7684dbb3b0b', 'dedce52f-926c-45ae-8b82-e0b2c9666224'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:02 devstack sudo[115888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:02 devstack sudo[115888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:02 devstack sudo[115888]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.267s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:02 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:20:02 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f09e54be-4177-4781-9d54-3b9886c2c0b5 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-84e0e59d-f021-4dfc-b969-9a9ce85f3ba1-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (daa1948f-8e16-42fa-a6c8-8517d7e80214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6caf7bb4-ab23-4e01-be7c-c2d8733b03a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6caf7bb4-ab23-4e01-be7c-c2d8733b03a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886773876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81964227-7e54-429f-9289-c7103ca086f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:03Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29432622-cd8c-4343-986e-ac92e05120bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29432622-cd8c-4343-986e-ac92e05120bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53154278-d726-4d4c-874c-2ad8d0ba4ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53154278-d726-4d4c-874c-2ad8d0ba4ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81964227-7e54-429f-9289-c7103ca086f7', 'volume_name': 'volume-81964227-7e54-429f-9289-c7103ca086f7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0301843b-0e76-47cf-95f4-b98f53987c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0301843b-0e76-47cf-95f4-b98f53987c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bdcfb9-77e0-40b0-9723-d5ea26f4f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:03 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Volume 81964227-7e54-429f-9289-c7103ca086f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81964227-7e54-429f-9289-c7103ca086f7', 'volume_size': 1} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-886773876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81964227-7e54-429f-9289-c7103ca086f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc41850cb62546dba445728704dad0fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:03Z,use_quota=True,user_id='6cfeaf74fd7a4cbc8298660a95534f2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Creating volume 81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:03 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:03 devstack sudo[115891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 1073741824 Aug 26 03:20:03 devstack sudo[115891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:03 devstack sudo[115891]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 1073741824" returned: 0 in 0.521s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:03 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:03 devstack sudo[115899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 Aug 26 03:20:03 devstack sudo[115899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:04 devstack sudo[115899]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bdcfb9-77e0-40b0-9723-d5ea26f4f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81964227-7e54-429f-9289-c7103ca086f7', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28298831-380f-47a7-8291-4bf7f2a4a991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:04 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Volume volume-81964227-7e54-429f-9289-c7103ca086f7 (81964227-7e54-429f-9289-c7103ca086f7): created successfully Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28298831-380f-47a7-8291-4bf7f2a4a991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:04 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Flow 'volume_create_manager' (daa1948f-8e16-42fa-a6c8-8517d7e80214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:04 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-3b9608ff-bb89-4cbc-a5cc-6e55ec4abc8d tempest-ProjectMemberTests-1946280196 None] Created volume successfully. Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Creating offline snapshot f839bb3b-9580-445b-b216-57994bca8a15 of volume 81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d773c07-ec6e-4b0f-b6a3-b44879736352]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:05 devstack sudo[115902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 Aug 26 03:20:05 devstack sudo[115902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:05 devstack sudo[115902]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7" returned: 0 in 0.352s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:05 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:05 devstack sudo[115907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 1G Aug 26 03:20:05 devstack sudo[115907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:06 devstack sudo[115907]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 1G" returned: 0 in 0.433s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81964227-7e54-429f-9289-c7103ca086f7 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:06 devstack sudo[115913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81964227-7e54-429f-9289-c7103ca086f7 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 Aug 26 03:20:06 devstack sudo[115913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:06 devstack sudo[115913]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81964227-7e54-429f-9289-c7103ca086f7 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15" returned: 0 in 0.304s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:06 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 is being set with open permissions: ugo+rw Aug 26 03:20:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:06 devstack sudo[115918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 Aug 26 03:20:06 devstack sudo[115918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:06 devstack sudo[115918]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15" returned: 0 in 0.256s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:06 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:06 devstack sudo[115921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info Aug 26 03:20:06 devstack sudo[115921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:07 devstack sudo[115921]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info" returned: 0 in 0.265s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:07 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info is being set with open permissions: ugo+rw Aug 26 03:20:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:07 devstack sudo[115924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info Aug 26 03:20:07 devstack sudo[115924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:07 devstack sudo[115924]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.info" returned: 0 in 0.351s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:07 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:07 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-e89ee4cd-699f-41b8-a7e3-e14e1ae957f1 tempest-ProjectMemberTests-1946280196 None] Create snapshot completed successfully Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-f839bb3b-9580-445b-b216-57994bca8a15-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-f839bb3b-9580-445b-b216-57994bca8a15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-81964227-7e54-429f-9289-c7103ca086f7" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-81964227-7e54-429f-9289-c7103ca086f7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-f839bb3b-9580-445b-b216-57994bca8a15" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-f839bb3b-9580-445b-b216-57994bca8a15" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Deleting offline snapshot f839bb3b-9580-445b-b216-57994bca8a15 of volume 81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] snapshot_file for this snap is: volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19004e4-a516-4274-8e04-6dd47a78be8f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:08 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:08 devstack sudo[115927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 Aug 26 03:20:08 devstack sudo[115927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:09 devstack sudo[115927]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15" returned: 0 in 0.356s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81964227-7e54-429f-9289-c7103ca086f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42fd601-eca2-42b7-bc99-eeb90ce73c27]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:09 devstack sudo[115933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 Aug 26 03:20:09 devstack sudo[115933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:09 devstack sudo[115933]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7" returned: 0 in 0.387s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:09 devstack sudo[115938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 Aug 26 03:20:09 devstack sudo[115938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:09 devstack sudo[115938]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15" returned: 0 in 0.352s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:09 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:09 devstack sudo[115943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15 Aug 26 03:20:09 devstack sudo[115943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:10 devstack sudo[115943]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7.f839bb3b-9580-445b-b216-57994bca8a15" returned: 0 in 0.245s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-f839bb3b-9580-445b-b216-57994bca8a15" released by "_delete_snapshot" :: held 1.436s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-81964227-7e54-429f-9289-c7103ca086f7" released by "delete_snapshot" :: held 1.459s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Created reservations ['7e98d658-106c-490f-863e-2dc93ffeade5', '1d706806-0c2a-464f-9f24-75c218883087', 'e23a7d76-98cd-47ff-b244-53a7a69d2a44', 'f14a7ebe-59d5-4930-a2de-e16ec893330d'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:10 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Delete snapshot completed successfully. Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-8ebd9253-7a4a-4e56-a9f1-db353fdaa300 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-f839bb3b-9580-445b-b216-57994bca8a15-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-81964227-7e54-429f-9289-c7103ca086f7-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-81964227-7e54-429f-9289-c7103ca086f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "cinder-quobyte-81964227-7e54-429f-9289-c7103ca086f7" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-81964227-7e54-429f-9289-c7103ca086f7" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a489ccb-500f-4ed1-83ca-58e5f3aad9f9]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:10 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:11 devstack sudo[115946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 Aug 26 03:20:11 devstack sudo[115946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:11 devstack sudo[115946]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7" returned: 0 in 0.381s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:11 devstack sudo[115951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7 Aug 26 03:20:11 devstack sudo[115951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:11 devstack sudo[115951]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-81964227-7e54-429f-9289-c7103ca086f7" returned: 0 in 0.248s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-quobyte-81964227-7e54-429f-9289-c7103ca086f7" released by "delete_volume" :: held 0.690s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Created reservations ['89d94877-cae9-4b25-8f1e-a3cf32def30d', '0025be1e-77a3-4a31-931d-eab0e9d93553', '42448863-ee63-4cc8-b215-462ea829d7b8', '60bbd0c0-8d47-4428-9fb4-8fc38dd44bf1'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:11 devstack sudo[115954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:11 devstack sudo[115954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:11 devstack sudo[115954]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.249s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:11 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Deleted volume successfully. Aug 26 03:20:11 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-9ed7093c-19a3-434f-b7bd-91571e2c8e02 tempest-ProjectMemberTests-1946280196 None] Lock "cinder-81964227-7e54-429f-9289-c7103ca086f7-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Flow 'volume_create_manager' (2a17b460-1fdf-4985-926f-6cb3842fdf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369f6e32-dc39-43d2-8464-1110ac711655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (369f6e32-dc39-43d2-8464-1110ac711655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-832514392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5168efd-c0a0-4e4f-ba25-9fe9f733b473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22a0cb947de4cbba729dde4bb1a4c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:14Z,use_quota=True,user_id='41015aab86f3416d81b725562e2f1430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c674dfc-f739-48c7-8d6d-6af4e28ff627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c674dfc-f739-48c7-8d6d-6af4e28ff627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8a04b8-e50b-4282-9095-23ca31ae7e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de8a04b8-e50b-4282-9095-23ca31ae7e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5168efd-c0a0-4e4f-ba25-9fe9f733b473', 'volume_name': 'volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8991d4-4482-4914-9ded-588f92c6a92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8991d4-4482-4914-9ded-588f92c6a92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83357311-8361-49f1-95ab-b7d973def114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:13 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Volume d5168efd-c0a0-4e4f-ba25-9fe9f733b473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473', 'volume_size': 1} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-832514392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5168efd-c0a0-4e4f-ba25-9fe9f733b473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22a0cb947de4cbba729dde4bb1a4c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:14Z,use_quota=True,user_id='41015aab86f3416d81b725562e2f1430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Creating volume d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:13 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:13 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:13 devstack sudo[115958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 1073741824 Aug 26 03:20:13 devstack sudo[115958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:14 devstack sudo[115958]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 1073741824" returned: 0 in 0.443s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:14 devstack sudo[115964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 Aug 26 03:20:14 devstack sudo[115964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:14 devstack sudo[115964]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" returned: 0 in 0.238s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83357311-8361-49f1-95ab-b7d973def114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2caa7f71-d5fa-40ad-a46c-b4bcc4a686b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:14 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Volume volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 (d5168efd-c0a0-4e4f-ba25-9fe9f733b473): created successfully Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2caa7f71-d5fa-40ad-a46c-b4bcc4a686b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Flow 'volume_create_manager' (2a17b460-1fdf-4985-926f-6cb3842fdf8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:14 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-be7dc00b-5fa8-4a36-b6c1-0b5c011cb84f tempest-SnapshotDependencyTests-1763877904 None] Created volume successfully. Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:14 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Creating offline snapshot beecc370-3afd-450e-975f-ac77246071d7 of volume d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 26 03:20:15 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[70658f73-a84f-4986-b941-61da3405faa8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:15 devstack sudo[115968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 Aug 26 03:20:15 devstack sudo[115968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:15 devstack sudo[115968]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" returned: 0 in 0.391s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 1G {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:15 devstack sudo[115974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 1G Aug 26 03:20:15 devstack sudo[115974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:15 devstack sudo[115974]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 1G" returned: 0 in 0.378s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:15 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:15 devstack sudo[115979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 Aug 26 03:20:15 devstack sudo[115979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115979]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 -F qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7" returned: 0 in 0.293s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 is being set with open permissions: ugo+rw Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 Aug 26 03:20:16 devstack sudo[115984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115984]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info Aug 26 03:20:16 devstack sudo[115987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115987]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info" returned: 0 in 0.262s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info is being set with open permissions: ugo+rw Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:16 devstack sudo[115990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info Aug 26 03:20:16 devstack sudo[115990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:16 devstack sudo[115990]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.info" returned: 0 in 0.259s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:16 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:16 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-ba6b9ac2-4ecd-41dd-a207-8e6b270902ea tempest-SnapshotDependencyTests-1763877904 None] Create snapshot completed successfully Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Flow 'volume_create_manager' (194ae391-db7f-48f2-a94f-7cab2ccfb17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff25b215-0735-42c8-b6ad-cc3e797ef9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff25b215-0735-42c8-b6ad-cc3e797ef9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=405d35e5-f99c-4114-b160-77f73d8b9155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22a0cb947de4cbba729dde4bb1a4c44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=beecc370-3afd-450e-975f-ac77246071d7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:18Z,use_quota=True,user_id='41015aab86f3416d81b725562e2f1430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ffc436-f4f7-4885-b62d-a8a63497b4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ffc436-f4f7-4885-b62d-a8a63497b4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777a02ef-fce3-4c24-8c9e-70bc70c36a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (777a02ef-fce3-4c24-8c9e-70bc70c36a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '405d35e5-f99c-4114-b160-77f73d8b9155', 'volume_name': 'volume-405d35e5-f99c-4114-b160-77f73d8b9155', 'volume_size': 1, 'snapshot_id': 'beecc370-3afd-450e-975f-ac77246071d7'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c33dca0-18ea-49e1-9edf-1edd32fe8fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c33dca0-18ea-49e1-9edf-1edd32fe8fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81246a1-700e-475a-b1fe-204705aa4c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:17 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Volume 405d35e5-f99c-4114-b160-77f73d8b9155: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-405d35e5-f99c-4114-b160-77f73d8b9155', 'volume_size': 1, 'snapshot_id': 'beecc370-3afd-450e-975f-ac77246071d7'} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-quobyte-beecc370-3afd-450e-975f-ac77246071d7-405d35e5-f99c-4114-b160-77f73d8b9155" by "_create_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-beecc370-3afd-450e-975f-ac77246071d7-405d35e5-f99c-4114-b160-77f73d8b9155" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Creating volume 405d35e5-f99c-4114-b160-77f73d8b9155 from snapshot beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-quobyte-405d35e5-f99c-4114-b160-77f73d8b9155" by "_copy_volume_from_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-405d35e5-f99c-4114-b160-77f73d8b9155" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] snapshot: beecc370-3afd-450e-975f-ac77246071d7, volume: 405d35e5-f99c-4114-b160-77f73d8b9155, {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e739256-7bc5-4520-8f64-8a6c2cf2ebe8]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:17 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:18 devstack sudo[115995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 Aug 26 03:20:18 devstack sudo[115995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:18 devstack sudo[115995]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7" returned: 0 in 0.380s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e394df-a21b-4ec0-8a43-34c14a262fec]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:18 devstack sudo[116000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 Aug 26 03:20:18 devstack sudo[116000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:18 devstack sudo[116000]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" returned: 0 in 0.383s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] will copy from snapshot at /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Creating direct copy from snapshot {{(pid=94506) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG cinder.utils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Path /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 not found in is_blk_device check {{(pid=94506) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Aug 26 03:20:18 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:18 devstack sudo[116005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 Aug 26 03:20:18 devstack sudo[116005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:20 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:20 devstack sudo[116024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:20 devstack sudo[116024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:21 devstack sudo[116024]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:21 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.825s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:21 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:21 devstack cinder-volume[94506]: DEBUG oslo_service.periodic_task [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] Running periodic task VolumeManager._thread_info {{(pid=94506) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 26 03:20:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread count: 29 {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 26 03:20:21 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-defe0a9d-efa5-4cce-853a-e0eb1147f1c3 None None] thread info: [<_MainThread(MainThread, started 124350419165312)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=94506) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 26 03:20:23 devstack sudo[116005]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155" returned: 0 in 4.829s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.image.image_utils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Image conversion details: src /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473, size 1024.00 MB, duration 4.83 sec, destination /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 {{(pid=94506) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 26 03:20:23 devstack cinder-volume[94506]: INFO cinder.image.image_utils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Converted 1024.00 MB image at 211.99 MB/s Aug 26 03:20:23 devstack cinder-volume[94506]: WARNING cinder.volume.drivers.remotefs [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 is being set with open permissions: ugo+rw Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:23 devstack sudo[116029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 Aug 26 03:20:23 devstack sudo[116029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:23 devstack sudo[116029]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-405d35e5-f99c-4114-b160-77f73d8b9155" released by "_copy_volume_from_snapshot" :: held 5.943s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-beecc370-3afd-450e-975f-ac77246071d7-405d35e5-f99c-4114-b160-77f73d8b9155" released by "_create_volume_from_snapshot" :: held 6.016s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.031s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81246a1-700e-475a-b1fe-204705aa4c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405d35e5-f99c-4114-b160-77f73d8b9155', 'volume_size': 1, 'snapshot_id': 'beecc370-3afd-450e-975f-ac77246071d7'}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40683554-54dd-4068-a92b-94772c21b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:23 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Volume volume-405d35e5-f99c-4114-b160-77f73d8b9155 (405d35e5-f99c-4114-b160-77f73d8b9155): created successfully Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40683554-54dd-4068-a92b-94772c21b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:23 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Flow 'volume_create_manager' (194ae391-db7f-48f2-a94f-7cab2ccfb17f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:23 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a464d9f7-6607-46ff-b391-a37f967f6bea tempest-SnapshotDependencyTests-1763877904 None] Created volume successfully. Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-beecc370-3afd-450e-975f-ac77246071d7-delete_snapshot" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-beecc370-3afd-450e-975f-ac77246071d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-quobyte-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" by "delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-quobyte-beecc370-3afd-450e-975f-ac77246071d7" by "_delete_snapshot" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-beecc370-3afd-450e-975f-ac77246071d7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Deleting offline snapshot beecc370-3afd-450e-975f-ac77246071d7 of volume d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] snapshot_file for this snap is: volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e1b598-e3aa-4a61-a8b8-1b50f7a7253e]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:24 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:24 devstack sudo[116032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 Aug 26 03:20:24 devstack sudo[116032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:25 devstack sudo[116032]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7" returned: 0 in 0.379s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:25 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94506) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 26 03:20:25 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccdf0cc-1db3-4275-ae6c-0750f66d74a7]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:25 devstack sudo[116037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 Aug 26 03:20:25 devstack sudo[116037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:25 devstack sudo[116037]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" returned: 0 in 0.601s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:25 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:25 devstack sudo[116042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 Aug 26 03:20:25 devstack sudo[116042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:26 devstack sudo[116042]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7" returned: 0 in 0.355s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:26 devstack sudo[116047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7 Aug 26 03:20:26 devstack sudo[116047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:26 devstack sudo[116047]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473.beecc370-3afd-450e-975f-ac77246071d7" returned: 0 in 0.283s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:UPDATE=147,cinder:SELECT=111,cinder:INSERT=37,cinder:DELETE=13 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-beecc370-3afd-450e-975f-ac77246071d7" released by "_delete_snapshot" :: held 1.724s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" released by "delete_snapshot" :: held 1.747s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=118,cinder:INSERT=40,cinder:UPDATE=137,cinder:DELETE=12 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Created reservations ['4aae6242-ba56-484f-a63f-d20fff451fd8', 'd6c836cc-c4e9-4f8d-99aa-74c246365955', 'f0b8dc71-4dad-4077-a2b3-bd0f5554816b', 'e17d6bfc-4338-4582-a202-91de4f4aa823'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:26 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Delete snapshot completed successfully. Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-80829104-7e55-4743-af0e-30b30e1ebcb0 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-beecc370-3afd-450e-975f-ac77246071d7-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Flow 'volume_create_manager' (8346472c-94ed-4687-93e3-3f7c1c54176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c5b7eb-33d3-4c8b-8676-60d909d373f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3c5b7eb-33d3-4c8b-8676-60d909d373f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615471982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab079398-a652-424d-9635-8f97d936a0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a5fdb09c4dd9a11d9587b209006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:27Z,use_quota=True,user_id='7ae342ab93e7455084aab15ba8d597d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9ef443-0df6-4572-a565-ce02f13789d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff9ef443-0df6-4572-a565-ce02f13789d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76872b5a-1f6f-4cb0-9087-d1c5a482059f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76872b5a-1f6f-4cb0-9087-d1c5a482059f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab079398-a652-424d-9635-8f97d936a0cf', 'volume_name': 'volume-ab079398-a652-424d-9635-8f97d936a0cf', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dad53b-143f-4719-9307-794acba61bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3dad53b-143f-4719-9307-794acba61bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c069aed9-6c76-49c5-b506-9971563aa726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:26 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Volume ab079398-a652-424d-9635-8f97d936a0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab079398-a652-424d-9635-8f97d936a0cf', 'volume_size': 1} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1615471982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab079398-a652-424d-9635-8f97d936a0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a5fdb09c4dd9a11d9587b209006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:27Z,use_quota=True,user_id='7ae342ab93e7455084aab15ba8d597d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Creating volume ab079398-a652-424d-9635-8f97d936a0cf {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:26 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-d5168efd-c0a0-4e4f-ba25-9fe9f733b473-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:26 devstack sudo[116050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf 1073741824 Aug 26 03:20:26 devstack sudo[116050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-d5168efd-c0a0-4e4f-ba25-9fe9f733b473-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-quobyte-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" acquired by "delete_volume" :: waited 0.017s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa784ce-0582-4aff-9c34-955f9471c68f]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:26 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:27 devstack sudo[116052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 Aug 26 03:20:27 devstack sudo[116052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:27 devstack sudo[116050]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf 1073741824" returned: 0 in 0.437s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:27 devstack sudo[116060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf Aug 26 03:20:27 devstack sudo[116060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:27 devstack sudo[116052]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" returned: 0 in 0.416s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:27 devstack sudo[116063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473 Aug 26 03:20:27 devstack sudo[116063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:27 devstack sudo[116060]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf" returned: 0 in 0.250s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c069aed9-6c76-49c5-b506-9971563aa726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab079398-a652-424d-9635-8f97d936a0cf', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e8ba87-0268-40c9-aca4-b4212ca7b577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:27 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Volume volume-ab079398-a652-424d-9635-8f97d936a0cf (ab079398-a652-424d-9635-8f97d936a0cf): created successfully Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e8ba87-0268-40c9-aca4-b4212ca7b577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Flow 'volume_create_manager' (8346472c-94ed-4687-93e3-3f7c1c54176c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:27 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-fd72d89d-e0e2-44d5-9ee8-f511169d0867 tempest-ProjectReaderTests-697929573 None] Created volume successfully. Aug 26 03:20:27 devstack sudo[116063]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" returned: 0 in 0.263s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-d5168efd-c0a0-4e4f-ba25-9fe9f733b473" released by "delete_volume" :: held 0.740s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Created reservations ['b1450cd2-2fd1-4e47-bbf8-4ae29d9f706e', '948743bd-fac0-4a21-96ab-f11b7a31b00c', 'b1fd0718-d3e8-4174-897b-13e56d7199d5', '98854a0c-9bd3-4c00-a19d-ba0e8d41c303'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:27 devstack sudo[116067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:27 devstack sudo[116067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Acquiring lock "cinder-ab079398-a652-424d-9635-8f97d936a0cf-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Lock "cinder-ab079398-a652-424d-9635-8f97d936a0cf-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Acquiring lock "cinder-quobyte-ab079398-a652-424d-9635-8f97d936a0cf" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:27 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-405d35e5-f99c-4114-b160-77f73d8b9155-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Lock "cinder-quobyte-ab079398-a652-424d-9635-8f97d936a0cf" acquired by "delete_volume" :: waited 0.026s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:28 devstack sudo[116067]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-405d35e5-f99c-4114-b160-77f73d8b9155-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4019c82-9735-424c-92cf-927a0d88de92]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.303s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:28 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Deleted volume successfully. Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "cinder-quobyte-405d35e5-f99c-4114-b160-77f73d8b9155" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-81fc12f8-0cb2-416d-a609-fb20ff127bbe tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-d5168efd-c0a0-4e4f-ba25-9fe9f733b473-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-405d35e5-f99c-4114-b160-77f73d8b9155" acquired by "delete_volume" :: waited 0.020s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0402ce-3538-4324-9ff2-ebfbfd4e42f2]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack sudo[116070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf Aug 26 03:20:28 devstack sudo[116070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:28 devstack sudo[116071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 Aug 26 03:20:28 devstack sudo[116071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:28 devstack sudo[116070]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf" returned: 0 in 0.393s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack sudo[116077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf Aug 26 03:20:28 devstack sudo[116077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:28 devstack sudo[116071]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155" returned: 0 in 0.368s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack sudo[116082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155 Aug 26 03:20:28 devstack sudo[116082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:28 devstack sudo[116077]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-ab079398-a652-424d-9635-8f97d936a0cf" returned: 0 in 0.267s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Lock "cinder-quobyte-ab079398-a652-424d-9635-8f97d936a0cf" released by "delete_volume" :: held 0.720s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:28 devstack sudo[116082]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-405d35e5-f99c-4114-b160-77f73d8b9155" returned: 0 in 0.251s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Created reservations ['2c97e550-edf6-4fe9-8a09-909cbc080968', '829a8dfe-3ecc-44df-9356-90c2873dab2c', '06305342-2d44-4248-92e6-cc7f1ce655f9', '92e07b7a-0679-4c5e-971f-e786ffbe2715'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-quobyte-405d35e5-f99c-4114-b160-77f73d8b9155" released by "delete_volume" :: held 0.663s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Created reservations ['031247f7-90a4-4c49-ab8c-b4aebfb59621', '6bd496bf-2e23-4fe5-ae3e-6a97c7a19907', '870e0d95-e647-4993-94f1-dd1a0e72c33a', 'd01b3ce8-ee5f-4ab8-b61b-837def6812f5'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:28 devstack sudo[116086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:28 devstack sudo[116086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:28 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:28 devstack sudo[116088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:28 devstack sudo[116088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:29 devstack sudo[116086]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.271s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:29 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Deleted volume successfully. Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-817cfb04-bc01-4b03-a8e2-30cf797026f1 tempest-ProjectReaderTests-697929573 None] Lock "cinder-ab079398-a652-424d-9635-8f97d936a0cf-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:29 devstack sudo[116088]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.334s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:29 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Deleted volume successfully. Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-5aa1f223-0f7d-4fbf-98f6-c93fcf38f477 tempest-SnapshotDependencyTests-1763877904 None] Lock "cinder-405d35e5-f99c-4114-b160-77f73d8b9155-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Flow 'volume_create_manager' (a7e36df7-64a9-4793-a03c-850b1494cca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359e397b-b2c1-4134-adb7-60ec840f6b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359e397b-b2c1-4134-adb7-60ec840f6b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242825185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a4300c-eca9-4039-978c-7ba75fa6386f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a5fdb09c4dd9a11d9587b209006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:30Z,use_quota=True,user_id='7ae342ab93e7455084aab15ba8d597d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dae0b6-0e0b-4c91-ad9f-ff1b3481c504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5dae0b6-0e0b-4c91-ad9f-ff1b3481c504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3173ded2-7cc2-4c6f-b9b5-847de76ba436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3173ded2-7cc2-4c6f-b9b5-847de76ba436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a4300c-eca9-4039-978c-7ba75fa6386f', 'volume_name': 'volume-b0a4300c-eca9-4039-978c-7ba75fa6386f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe88e44d-0254-40a9-862d-1ba795d718ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe88e44d-0254-40a9-862d-1ba795d718ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad712ea-f598-462a-93bf-9d32b8a15a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:29 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Volume b0a4300c-eca9-4039-978c-7ba75fa6386f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a4300c-eca9-4039-978c-7ba75fa6386f', 'volume_size': 1} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242825185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a4300c-eca9-4039-978c-7ba75fa6386f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c74a5fdb09c4dd9a11d9587b209006a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:30Z,use_quota=True,user_id='7ae342ab93e7455084aab15ba8d597d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Creating volume b0a4300c-eca9-4039-978c-7ba75fa6386f {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:29 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:29 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:29 devstack sudo[116092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f 1073741824 Aug 26 03:20:29 devstack sudo[116092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:30 devstack sudo[116092]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f 1073741824" returned: 0 in 0.539s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:30 devstack sudo[116132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f Aug 26 03:20:30 devstack sudo[116132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:30 devstack sudo[116132]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f" returned: 0 in 0.273s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad712ea-f598-462a-93bf-9d32b8a15a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a4300c-eca9-4039-978c-7ba75fa6386f', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21d14fd-ee32-4880-a757-acdccab87b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:30 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Volume volume-b0a4300c-eca9-4039-978c-7ba75fa6386f (b0a4300c-eca9-4039-978c-7ba75fa6386f): created successfully Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a21d14fd-ee32-4880-a757-acdccab87b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:30 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Flow 'volume_create_manager' (a7e36df7-64a9-4793-a03c-850b1494cca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:30 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-fd9bbfac-b4cb-4708-bc8b-a8ce59343057 tempest-ProjectReaderTests-697929573 None] Created volume successfully. Aug 26 03:20:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Acquiring lock "cinder-b0a4300c-eca9-4039-978c-7ba75fa6386f-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Lock "cinder-b0a4300c-eca9-4039-978c-7ba75fa6386f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Acquiring lock "cinder-quobyte-b0a4300c-eca9-4039-978c-7ba75fa6386f" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:31 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Lock "cinder-quobyte-b0a4300c-eca9-4039-978c-7ba75fa6386f" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:31 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[518aaec1-514d-4175-aa2d-05d1813ed04b]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:31 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:31 devstack sudo[116138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f Aug 26 03:20:31 devstack sudo[116138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:32 devstack sudo[116138]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f" returned: 0 in 0.390s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:32 devstack sudo[116143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f Aug 26 03:20:32 devstack sudo[116143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:32 devstack sudo[116143]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-b0a4300c-eca9-4039-978c-7ba75fa6386f" returned: 0 in 0.245s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Lock "cinder-quobyte-b0a4300c-eca9-4039-978c-7ba75fa6386f" released by "delete_volume" :: held 0.678s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Created reservations ['0cf4f29a-b714-490e-b760-2dd7d5d9c31e', 'e6926076-51fa-4dc3-9fae-8dc0a788ada5', 'aa3f73bd-1e82-43ea-a1da-84333dac7fef', 'dafb8b91-1d27-4aff-a138-4eaff3749dd1'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:32 devstack sudo[116146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:32 devstack sudo[116146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:32 devstack sudo[116146]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.255s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:32 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Deleted volume successfully. Aug 26 03:20:32 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-cc03bad2-3b24-454e-a956-dd35ff882821 tempest-ProjectReaderTests-697929573 None] Lock "cinder-b0a4300c-eca9-4039-978c-7ba75fa6386f-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (f540f0ea-8493-4eb3-95b1-844286f9effa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8320506f-be75-46ba-bdff-cdd660c244c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8320506f-be75-46ba-bdff-cdd660c244c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1042880559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3440aa-4dc0-40fd-959e-3ebd6ff827d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:37Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f27f7ab-579d-4ded-a449-12c94b50813e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f27f7ab-579d-4ded-a449-12c94b50813e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478d4a47-13ff-4d71-98a5-9ac1819189fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478d4a47-13ff-4d71-98a5-9ac1819189fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b3440aa-4dc0-40fd-959e-3ebd6ff827d6', 'volume_name': 'volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75515411-c5a2-4c79-acdf-75d1d7d7bba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75515411-c5a2-4c79-acdf-75d1d7d7bba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20de70cb-1f11-4428-8f46-38861ca4bb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:37 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Volume 2b3440aa-4dc0-40fd-959e-3ebd6ff827d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6', 'volume_size': 1} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1042880559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b3440aa-4dc0-40fd-959e-3ebd6ff827d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:37Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Creating volume 2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:37 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:37 devstack sudo[116153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 1073741824 Aug 26 03:20:37 devstack sudo[116153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:37 devstack sudo[116153]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 1073741824" returned: 0 in 0.445s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:37 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:37 devstack sudo[116159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 Aug 26 03:20:37 devstack sudo[116159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:38 devstack sudo[116159]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6" returned: 0 in 0.265s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20de70cb-1f11-4428-8f46-38861ca4bb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e99f4d-30cb-4d47-9074-5367ddfd966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:38 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Volume volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 (2b3440aa-4dc0-40fd-959e-3ebd6ff827d6): created successfully Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22e99f4d-30cb-4d47-9074-5367ddfd966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:38 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (f540f0ea-8493-4eb3-95b1-844286f9effa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:38 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-cf8ebaa2-db32-4798-a05b-f8b304703244 tempest-ProjectReaderTests-695146010 None] Created volume successfully. Aug 26 03:20:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Lock "cinder-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-quobyte-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:39 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:39 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e78d8a-ef3c-4f71-b260-ea913d659256]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:39 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:39 devstack sudo[116163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 Aug 26 03:20:39 devstack sudo[116163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:40 devstack sudo[116163]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6" returned: 0 in 0.372s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:40 devstack sudo[116168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6 Aug 26 03:20:40 devstack sudo[116168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:40 devstack sudo[116168]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6" returned: 0 in 0.274s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6" released by "delete_volume" :: held 0.686s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Created reservations ['bd1da179-a983-41e0-9c61-ff73be0f59ec', '158ccb4a-60d7-4bc9-acc2-8448d9cd6e71', '5fd51fd7-d516-4311-bdba-7e8ae0ed483c', '63f9f31a-1a6f-45e8-9271-e0f073e1d637'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:40 devstack sudo[116171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:40 devstack sudo[116171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:40 devstack sudo[116171]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:40 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Deleted volume successfully. Aug 26 03:20:40 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-a68b597d-2aa9-4a87-ba50-4a48a0ac9e30 tempest-ProjectReaderTests-695146010 None] Lock "cinder-2b3440aa-4dc0-40fd-959e-3ebd6ff827d6-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (e5af8ec2-1cb3-4c4c-83cc-420c3375a62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7045687-fcdc-415d-8857-7d099006fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7045687-fcdc-415d-8857-7d099006fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918817917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:41Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57a3edf-ce1d-4f8c-8a3a-e81f3f0ef0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57a3edf-ce1d-4f8c-8a3a-e81f3f0ef0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00522a6-176f-449a-b743-e861e889e0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e00522a6-176f-449a-b743-e861e889e0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad', 'volume_name': 'volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae318465-8596-4e06-a7b5-b39a43df29b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae318465-8596-4e06-a7b5-b39a43df29b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f9abc5-9dc0-410f-9229-2afa725b9bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Volume c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad', 'volume_size': 1} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-918817917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:41Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Creating volume c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:41 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:41 devstack sudo[116174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad 1073741824 Aug 26 03:20:41 devstack sudo[116174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:41 devstack sudo[116174]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad 1073741824" returned: 0 in 0.396s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:41 devstack sudo[116180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad Aug 26 03:20:41 devstack sudo[116180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:41 devstack sudo[116180]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad" returned: 0 in 0.235s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.675s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f9abc5-9dc0-410f-9229-2afa725b9bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e255e51-d61e-4041-a96e-2ecccd98d80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:41 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Volume volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad (c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad): created successfully Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e255e51-d61e-4041-a96e-2ecccd98d80d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:41 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (e5af8ec2-1cb3-4c4c-83cc-420c3375a62f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:42 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-720f807e-3b68-4fd9-8cb9-b9c758e67349 tempest-ProjectReaderTests-695146010 None] Created volume successfully. Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Lock "cinder-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-quobyte-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83dc12b-8416-4f76-8812-b2b724382081]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:42 devstack sudo[116183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad Aug 26 03:20:42 devstack sudo[116183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:42 devstack sudo[116183]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad" returned: 0 in 0.347s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:42 devstack sudo[116188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad Aug 26 03:20:42 devstack sudo[116188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:42 devstack sudo[116188]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad" returned: 0 in 0.254s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:42 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad" released by "delete_volume" :: held 0.642s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Created reservations ['34d3ba29-f0cd-4772-ab40-f4bdaf9e17c0', '9d65cadc-9167-4773-a8df-32926f0c2d84', '56e60dff-dca2-4b24-9724-fd365c65bd35', 'a423dd8f-1bd3-416b-bf10-652baa82da73'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:43 devstack sudo[116191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:43 devstack sudo[116191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:43 devstack sudo[116191]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.245s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:43 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Deleted volume successfully. Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-4fe80122-58d8-44bd-9b79-dfa47996875e tempest-ProjectReaderTests-695146010 None] Lock "cinder-c7abc742-63e1-44eb-8ff9-6e7d3ccfd9ad-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (f4b947c8-8bdb-40c5-909a-141ba7af6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfa9f42-966c-400b-b51e-c85ad8bcc143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfa9f42-966c-400b-b51e-c85ad8bcc143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870957013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7001e-572c-43b4-873a-fdc4642ef75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:44Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8558a111-0aba-447b-9cf7-d32d992b69f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8558a111-0aba-447b-9cf7-d32d992b69f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c2d503-d9db-4c12-a4d7-833ce2890c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56c2d503-d9db-4c12-a4d7-833ce2890c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a7001e-572c-43b4-873a-fdc4642ef75d', 'volume_name': 'volume-a9a7001e-572c-43b4-873a-fdc4642ef75d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45920ec6-ef03-4a77-97f9-eca6a9b45f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45920ec6-ef03-4a77-97f9-eca6a9b45f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c05e51-8fd7-41ea-9a5f-c80d1f9b5266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:43 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Volume a9a7001e-572c-43b4-873a-fdc4642ef75d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a7001e-572c-43b4-873a-fdc4642ef75d', 'volume_size': 1} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1870957013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a7001e-572c-43b4-873a-fdc4642ef75d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:44Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Creating volume a9a7001e-572c-43b4-873a-fdc4642ef75d {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:43 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:43 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:43 devstack sudo[116195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d 1073741824 Aug 26 03:20:43 devstack sudo[116195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:44 devstack sudo[116195]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d 1073741824" returned: 0 in 0.422s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:44 devstack sudo[116200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d Aug 26 03:20:44 devstack sudo[116200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:44 devstack sudo[116200]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d" returned: 0 in 0.243s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c05e51-8fd7-41ea-9a5f-c80d1f9b5266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a7001e-572c-43b4-873a-fdc4642ef75d', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93a7bdd-4285-4940-8d6c-3d016f30ad5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:44 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Volume volume-a9a7001e-572c-43b4-873a-fdc4642ef75d (a9a7001e-572c-43b4-873a-fdc4642ef75d): created successfully Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a93a7bdd-4285-4940-8d6c-3d016f30ad5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (f4b947c8-8bdb-40c5-909a-141ba7af6415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:44 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-d235eb3f-f845-49f1-b445-4ca26fac5ff5 tempest-ProjectReaderTests-695146010 None] Created volume successfully. Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-a9a7001e-572c-43b4-873a-fdc4642ef75d-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Lock "cinder-a9a7001e-572c-43b4-873a-fdc4642ef75d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-quobyte-a9a7001e-572c-43b4-873a-fdc4642ef75d" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:44 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-a9a7001e-572c-43b4-873a-fdc4642ef75d" acquired by "delete_volume" :: waited 0.015s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea161e7-b8d6-4cfa-9af6-ebc3eecddcf5]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:45 devstack sudo[116203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d Aug 26 03:20:45 devstack sudo[116203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:45 devstack sudo[116203]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d" returned: 0 in 0.364s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:45 devstack sudo[116208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d Aug 26 03:20:45 devstack sudo[116208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:45 devstack sudo[116208]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-a9a7001e-572c-43b4-873a-fdc4642ef75d" returned: 0 in 0.234s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-a9a7001e-572c-43b4-873a-fdc4642ef75d" released by "delete_volume" :: held 0.632s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Created reservations ['f337d914-27a5-45e0-bbfc-d4dcfecf5d49', '9b219bdc-a506-4303-996a-ad59bc3fe227', 'eb49a7f9-7f66-4e72-81c9-c6733d5a201f', 'e7654c0a-29d2-4e93-93f2-78247dd8e939'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:45 devstack sudo[116211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:45 devstack sudo[116211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:45 devstack sudo[116211]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.244s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:45 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Deleted volume successfully. Aug 26 03:20:45 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-f47e427d-bcb9-4ccc-823c-38c5f43f74bf tempest-ProjectReaderTests-695146010 None] Lock "cinder-a9a7001e-572c-43b4-873a-fdc4642ef75d-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.flows.manager.create_volume [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94506) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (41bf36b7-6264-405a-b780-38e7144c63f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d016163e-d4be-444b-b10f-4f027ef9634d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d016163e-d4be-444b-b10f-4f027ef9634d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-239629372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda720aa-223d-40f5-8997-5a7ad0508379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:46Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b335ed56-5e7d-4983-adc9-83e8c0da1a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b335ed56-5e7d-4983-adc9-83e8c0da1a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47d07e5-0644-4a14-bfa1-c343d715c820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47d07e5-0644-4a14-bfa1-c343d715c820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda720aa-223d-40f5-8997-5a7ad0508379', 'volume_name': 'volume-dda720aa-223d-40f5-8997-5a7ad0508379', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324505b6-a1a2-4228-a7a2-30808b951f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (324505b6-a1a2-4228-a7a2-30808b951f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c68afac-efda-4761-b4be-11e99fea2773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:46 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Volume dda720aa-223d-40f5-8997-5a7ad0508379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda720aa-223d-40f5-8997-5a7ad0508379', 'volume_size': 1} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-26T01:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-239629372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dda720aa-223d-40f5-8997-5a7ad0508379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='126f77fcb705489ba7b1d70967e388fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-26T01:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-26T01:20:46Z,use_quota=True,user_id='355f7a7e68e3469daa440e1ccc40b000',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ce340c-e3db-438a-9621-8ed88646791b),volume_type_id=c6ce340c-e3db-438a-9621-8ed88646791b)}" {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.remotefs [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Creating volume dda720aa-223d-40f5-8997-5a7ad0508379 {{(pid=94506) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Selected osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de as target Quobyte volume. {{(pid=94506) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Aug 26 03:20:46 devstack cinder-volume[94506]: INFO cinder.volume.drivers.remotefs [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] casted to osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 1073741824 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:46 devstack sudo[116214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 1073741824 Aug 26 03:20:46 devstack sudo[116214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:46 devstack sudo[116214]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:46 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 1073741824" returned: 0 in 0.385s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:47 devstack sudo[116220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 Aug 26 03:20:47 devstack sudo[116220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:47 devstack sudo[116220]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379" returned: 0 in 0.238s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'} {{(pid=94506) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c68afac-efda-4761-b4be-11e99fea2773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda720aa-223d-40f5-8997-5a7ad0508379', 'volume_size': 1}' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca381615-21bb-4d7b-ab1d-23fa2f958905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 26 03:20:47 devstack cinder-volume[94506]: INFO cinder.volume.flows.manager.create_volume [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Volume volume-dda720aa-223d-40f5-8997-5a7ad0508379 (dda720aa-223d-40f5-8997-5a7ad0508379): created successfully Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca381615-21bb-4d7b-ab1d-23fa2f958905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94506) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Flow 'volume_create_manager' (41bf36b7-6264-405a-b780-38e7144c63f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94506) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 26 03:20:47 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-208d41e7-bbaf-41d4-a5e9-ebe511c6171f tempest-ProjectReaderTests-695146010 None] Created volume successfully. Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-dda720aa-223d-40f5-8997-5a7ad0508379-delete_volume" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Lock "cinder-dda720aa-223d-40f5-8997-5a7ad0508379-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Acquiring lock "cinder-quobyte-dda720aa-223d-40f5-8997-5a7ad0508379" by "delete_volume" {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-dda720aa-223d-40f5-8997-5a7ad0508379" acquired by "delete_volume" :: waited 0.019s {{(pid=94506) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo.privsep.daemon [-] privsep: reply[75730152-e6f2-42d0-b138-794134b32226]: (4, 'qcow2') {{(pid=96329) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:47 devstack sudo[116223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 Aug 26 03:20:47 devstack sudo[116223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:47 devstack sudo[116223]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379" returned: 0 in 0.329s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:47 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:47 devstack sudo[116228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379 Aug 26 03:20:47 devstack sudo[116228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:48 devstack sudo[116228]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed/volume-dda720aa-223d-40f5-8997-5a7ad0508379" returned: 0 in 0.252s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Lock "cinder-quobyte-dda720aa-223d-40f5-8997-5a7ad0508379" released by "delete_volume" :: held 0.622s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG cinder.quota [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Created reservations ['362c4bca-41a7-4ef8-a29d-82f8796b2367', '2dbc6587-79e4-4395-abf0-8328bdd199f7', 'aafb2c49-3444-4149-ba69-722228013450', '0eacf9d3-c097-4223-baab-453b4e816908'] {{(pid=94506) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de': None} {{(pid=94506) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG cinder.volume.drivers.quobyte [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e4672f46-d5ea-4382-ba93-508dc8f1a3de'] {{(pid=94506) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.lockutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94506) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 26 03:20:48 devstack sudo[116231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed Aug 26 03:20:48 devstack sudo[116231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 26 03:20:48 devstack sudo[116231]: pam_unix(sudo:session): session closed for user root Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG oslo_concurrency.processutils [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/478c572419cd4c9cfb0c354746ca8aed" returned: 0 in 0.235s {{(pid=94506) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG cinder.manager [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Notifying Schedulers of capabilities ... {{(pid=94506) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 26 03:20:48 devstack cinder-volume[94506]: INFO cinder.volume.manager [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Deleted volume successfully. Aug 26 03:20:48 devstack cinder-volume[94506]: DEBUG cinder.coordination [None req-24b2acb8-04ee-48ad-bdff-b772711f64f9 tempest-ProjectReaderTests-695146010 None] Lock "cinder-dda720aa-223d-40f5-8997-5a7ad0508379-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=94506) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 26 03:20:58 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:SELECT=54,cinder:INSERT=20,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 26 03:20:58 devstack cinder-volume[94506]: DEBUG dbcounter [-] [94506] Writing DB stats cinder:INSERT=22,cinder:UPDATE=91,cinder:SELECT=56,cinder:DELETE=7 {{(pid=94506) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}